About the Role:
LLM/SLM Specialist to drive the development, deployment, and optimization of large language models (LLMs) and small language models (SLMs). You will have expertise in natural language processing (NLP), machine learning (ML), and AI model fine-tuning. You will be responsible for training, fine-tuning, evaluating, and integrating language models into various applications/web use interface using Infinite AI Training/serving architecture to accelerate our ability to deliver Generative AI in the Technology Operate and Production Management Team.
Key Responsibilities:
- Research, develop, and optimize large and small language models for various applications/ web use interface.
- Fine-tune pre-trained models using domain-specific datasets.
- Implement, evaluate, and improve NLP pipelines to enhance model performance.
- Design efficient training workflows and optimize inference performance.
- Work with cross-functional teams to integrate LLM/SLM capabilities into products.
- Ensure responsible AI principles are followed, including bias mitigation and ethical AI practices.
- Monitor advancements in the field of generative AI and recommend improvements.
- Develop APIs and tools for easier model deployment and accessibility.
- Conduct rigorous testing and benchmarking of language models.
Required Skills and Experience:
- Experience with LLMs (e.g., GPT, LLaMA, Falcon) and SLMs (e.g., distilled models, task-specific fine-tuned models).
- Proficiency in NLP techniques such as tokenization, embeddings, and attention mechanisms.
- Experience in data preprocessing, augmentation, and curation for training robust models.
- Hands-on experience with cloud computing services (AWS, GCP, Azure) and MLOps tools.
- Knowledge of vector databases, RAG (Retrieval-Augmented Generation), and prompt engineering.
- Strong coding skills in Python and familiarity with relevant libraries (Transformers, Hugging Face, LangChain).
- Excellent problem-solving skills and ability to work in a collaborative team environment.