Senior Python Developer, Backend

We are seeking a Senior Python Backend Developer to build robust AI-powered API services and agentic workflows, focusing on language model interaction with internal systems, vector databases, and external tools via orchestration frameworks. The ideal candidate will treat LLMs as components in a secure, scalable distributed system, owning API contracts and service reliability end-to-end.

Responsibilities

• Design and build backend API services and LLM orchestration layers
• Implement and maintain complex RAG pipelines, including document ingestion, chunking, embedding, and retrieval optimization
• Develop and connect agent tools using orchestration frameworks
• Ensure security, privacy, enterprise-grade observability, and test coverage for all backend workflows
• Contribute to architecture decisions and engineering standards within the pod
• Collaborate with frontend engineers, data engineers, and infrastructure teams
• Own API contracts and service reliability end-to-end, ensuring AI edge cases fail gracefully
• Integrate LLMs using rigorous systems engineering, incorporating evaluation, observability, fallback handling, and cost awareness
• Build reliable, reusable orchestration frameworks and logic for downstream developer consumption

Requirements

• 3+ years of backend engineering experience, focused on microservices and distributed systems
• Proficiency in Python for high-performance backend services and cloud-native APIs
• Familiarity with AWS, Docker, and ECS/EKS
• Knowledge of RESTful APIs
• Background in secure coding practices and strong auth/authz fundamentals
• English proficiency at B2 level or higher

Nice to have

• Showcase of hands-on experience with AI SDKs (OpenAI, Anthropic/Claude, AWS Bedrock, or equivalent) in production
• Practical experience with vector databases (Amazon Kendra, OpenSearch), embedding strategies, and retrieval systems
• Hands-on experience with LangChain, LlamaIndex, or LangGraph
• Familiarity with AI evaluation tooling or real-time APM (LangSmith, Langfuse, Arize)
• Skills in React and TypeScript
• Experience deploying to EKS environments at scale
• Understanding of agent interoperability patterns (MCP)
• Knowledge of identity/security domain (IAM, CIAM)
• Familiarity with secondary languages such as Java, Node.js, or Go

Benefits

• International projects with top brands
• Work with global teams of highly skilled, diverse peers
• Healthcare benefits
• Employee financial programs
• Paid time off and sick leave
• Upskilling, reskilling and certification courses
• Unlimited access to the LinkedIn Learning library and 22,000+ courses
• Global career opportunities
• Volunteer and community involvement opportunities
• EPAM Employee Groups
• Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn