Ouryahoo · United States of America ·
Lead R&D on large-scale generative AI and NLP models for Yahoo Mail, optimizing transformers, distillation, and evaluation frameworks to power personalized inbox experiences for hundreds of millions of users.
A Little About Us
The Mail Intelligence team is the brain behind the inbox. We are responsible for building the next generation of platforms and services that enable Yahoo to deliver deeply personalized, intelligent, and context-aware experiences to hundreds of millions of users globally. We process billions of messages and manage data on a petabyte scale. Using cutting-edge AI algorithms and foundation models, we extract knowledge and interconnect information from diverse sources to simplify our users' lives. Building this knowledge provides many challenges in the areas of natural language processing, machine learning techniques, and petabyte-scale data processing. You will build tools and workflows to make it easier to manage and act on this vast information, applying your insights to build innovative consumer applications for Yahoo Mail.
A Lot About You
You are a seasoned Applied ML Researcher who thrives at the intersection of theoretical innovation and production-grade execution. You don't just follow the latest LLM trends; you understand the mechanics of transformer architectures and how to optimize them for massive scale. You have expertise working across multiple ML and NLP spaces—including summarization, information extraction, classification, and ranking—at a very large scale. You have hands-on experience with knowledge distillation and believe that a model is only as good as its evaluation framework and low-latency production performance. You combine strong research fundamentals with pragmatic production instincts, comfortably navigating ambiguity to drive high-impact initiatives independently while mentoring and elevating engineering peers.
Responsibilities
Lead R&D: Drive the research strategy and development of deep learning and generative AI models specifically tailored for large-scale email and communication data.
Model Innovation & Optimization: Define and advance approaches for fine-tuning and adapting open-source foundation models using parameter-efficient techniques (LoRA, adapters) and quantization-aware training.
Efficiency at Scale: Design and implement knowledge distillation to transfer complex capabilities into smaller, high-performance models operating under strict latency budgets.
Modern Evaluation Strategy: Establish and standardize robust evaluation frameworks, including LLM-as-a-judge methodologies, synthetic evaluation datasets, and human-in-the-loop validation.
Product Integration: Build repeatable, scalable training and evaluation workflows for high-throughput production environments.
AI-Augmented Development Workflow: Integrate AI pair-programming tools (e.g., Copilot, Cursor) and automated LLM workflows to accelerate experimental iteration, code generation, and research prototyping.
Strategic Future-Proofing: Set technical direction for agent-based systems, tool-use paradigms, and long-term generative AI roadmaps.
Technical Mentorship & Governance: Raise the bar for technical excellence by guiding researchers, shaping org-wide AI technical strategy, and establishing best practices for model validation.
Qualifications
PhD (preferred) or Master’s degree in Computer Science, Machine Learning, NLP, or a related field.
9+ years of hands-on experience in applied machine learning and deep learning, with significant hands-on work in NLP and generative models at scale.
Demonstrated experience fine-tuning LLMs using LoRA or other parameter-efficient methods.
Experience with knowledge distillation, model compression, and/or training smaller models from larger teacher models.
Hands-on experience using LLMs for pseudo-labeling and synthetic data generation to create high-quality training datasets.
Experience building and evaluating LLM-based agents, including tool use, multi-agent orchestration, and reasoning workflows.
Deep understanding of transformer architectures (encoder-only, decoder-only, encoder-decoder) and modern generative transformer techniques.
Experience designing evaluation frameworks for generative systems, including prompt-based evaluation, LLM-as-a-judge approaches, and automated output validation.
Hands-on experience incorporating AI pair-programming tools (e.g., GitHub Copilot, Cursor) or LLM workbench environments into daily developer and research workflows.
Proficiency in Python and deep learning frameworks such as PyTorch or TensorFlow, along with Hugging Face tooling.
Experience building scalable data pipelines and training workflows for large datasets.
Strong experimental rigor and ability to translate research ideas into production-ready systems.
Excellent communication skills and ability to operate effectively in cross-functional, fast-moving environments.
Preferred Qualifications
Experience with large-scale distributed training and inference.
Experience building, deploying, and optimizing models for on-device or resource-constrained environments (quantization, pruning, distillation).
Experience with agent frameworks, tool use, or multi-step reasoning systems.
Familiarity with prompt engineering, preference optimization (RLHF/DPO), or model alignment techniques.
Publications, patents, or open-source contributions in NLP or generative AI.
Experience working with cloud platforms (GCP, AWS) and large-scale experimentation infrastructure.
The material job duties and responsibilities of this role include those listed above as well as adhering to Yahoo policies; exercising sound judgment; working effectively, safely and inclusively with others; exhibiting trustworthiness and meeting expectations; and safeguarding business operations and brand integrity.
At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, just ask the recruiter!
Yahoo is proud to be an equal opportunity workplace. All qualified applicants will receive consideration for employment without regard to, and will not be discriminated against based on age, race, gender, color, religion, national origin, sexual orientation, gender identity, veteran status, disability or any other protected category. Yahoo will consider for employment qualified applicants with criminal histories in a manner consistent with applicable law. Yahoo is dedicated to providing an accessible environment for all candidates during the application process and for employees during their employment. If you need accessibility assistance and/or a reasonable accommodation due to a disability, please submit a request via the Accommodation Request Form () or call +1.866.772.3182. Requests and calls received for non-disability related issues, such as following up on an application, will not receive a response.
We believe that a diverse and inclusive workplace strengthens Yahoo and deepens our relationships. When you support everyone to be their best selves, they spark discovery, innovation and creativity. Among other efforts, our 11 employee resource groups (ERGs) enhance a culture of belonging with programs, events and fellowship that help educate, support and create a workplace where all feel welcome.
The compensation for this position ranges from $128,250.00 - $266,875.00/yr and will vary depending on factors such as your location, skills and experience.The compensation package may also include incentive compensation opportunities in the form of discretionary annual bonus or commissions. Our comprehensive benefits include healthcare, a great 401k, backup childcare, education stipends and much (much) more.Currently work for Yahoo? Please apply on our internal career site.