Senior/Sr. Staff AI Infrastructure Engineer, Inference & Optimization
Didi Labs · San Jose, CA ·
- Work mode
- Remote
- Seniority
- Staff
- Category
- Devops
Designs and optimizes large-language-model inference systems, quantizing models, deploying LLMs, and scaling GPU-based pipelines for low-latency production use.
- Apply model quantization
- Architect LLM deployment environments
- Build system stability frameworks
- Collaborate with perception prediction teams
- Enable rapid model iteration
- Establish profiling and telemetry frameworks
- Integrate optimization toolchains
- Lead root cause analysis
- Monitor GPU utilization
- Optimize hardware execution
- Optimize inference performance
- Own model deployment
- Scale service deployment pipelines
- Schedule compute resources