LLM Fine-Tuning Engineer (Open-Weight Models / Secure Environments)

We are hiring an LLM Fine-Tuning Engineer to help us adapt and evaluate open-weight language models for use in secure environments.

This role is focused on the full post-training lifecycle: dataset design, supervised fine-tuning, parameter-efficient tuning, synthetic data generation, evaluation, and deployment support. You will work closely with technical teams operating in advanced cybersecurity contexts, helping turn foundation models into reliable task-specific systems.

IMPORTANT NOTE: We are not looking for prompt engineers or “LLM whisperers.” We are looking for someone who understands post-training, data evaluation, and deployment deeply enough to make open-weight models reliable in real operational environments.

What You’ll Do

• Fine-tune and adapt open-weight LLMs for specialized use cases in secure/local environments

• Design, run, and compare different post-training approaches, including:

  • supervised fine-tuning (SFT)

  • parameter-efficient fine-tuning (LoRA / QLoRA and related methods)

  • preference tuning approaches such as DPO where appropriate

  • full fine-tuning when justified by the use case

• Build and improve high-quality datasets for training and evaluation

• Generate synthetic data and use it responsibly to expand coverage, improve robustness, and accelerate iteration

• Assess model quality beyond headline metrics

• Work with engineering teams to operationalize tuned models for local or restricted deployments

• Collaborate with domain experts to translate real operational needs into measurable model requirements

What We’re Looking For

• Strong experience fine-tuning LLMs or adjacent foundation models in production or serious research environments

• Practical experience with multiple tuning approaches, ideally including SFT, LoRA, QLoRA

• Experience building and curating datasets for post-training

• Experience generating and validating synthetic data for model training

• Strong Python skills and solid experience with:

  • PyTorch

  • Hugging Face Transformers

  • tokenization, data preprocessing and training pipelines

• Good understanding of GPU constraints, memory/performance tradeoffs, quantization-aware workflows and practical training optimization

• Strong debugging mindset and ability to investigate why a model improved, regressed, or failed

Nice to Have

• Experience with secure, air-gapped, or otherwise restricted deployment environments

• Experience deploying or serving tuned models

• Background in cybersecurity, especially offensive security, vulnerability research

• Experience with distributed training frameworks

How We Think About the Role

This is not a “prompt engineer” role, and it is not limited to running a few LoRA jobs. We want someone who can think deeply about:

• when fine-tuning is the right tool versus prompting or orchestration

• how to create data that improves behavior instead of just inflating metrics

• how to evaluate models in ways that reflect real operational value

• how to make open-weight models reliable in constrained environments