Build and optimize distributed LLM serving infrastructure, integrating container orchestration, networking, and hardware acceleration for Google Distributed Cloud AI.
- Collaborate with teams on LLM frameworks container orchestration networking hardware acceleration
- Drive integration across platform services billing logging observability security quota
- Implement enhance LLM serving capabilities for advanced techniques
- Lead software design development optimization for LLM inference serving