AI Platform Engineer – Cloud & Healthcare

NEOLYTIX
Job Description

AI Platform Engineer – Cloud & HealthcareLocation
Gurugram, India (Hybrid)Employment Type
Full-Time Neolytix is a US-based healthcare technology and services company with 220+ employees across Chicago, Gurugram, and Manila. We serve 270+ provider organizations across revenue cycle management, credentialing, medical coding, and AI-enabled services. We are in an active phase of building proprietary technology platforms that sit at the intersection of healthcare operations and artificial intelligence.
This role sits at the center of that build — owning the infrastructure that makes AI safe, compliant, and usable across our internal teams and client-facing products.
We are hiring an AI Platform Engineer to own the build, configuration, and ongoing operation of our HIPAA-compliant AI infrastructure layer. This is not an application development role — it is an infrastructure and integration role. The architecture decisions are made; we need someone who can execute with precision, document rigorously, and serve as the internal expert who keeps the platform running and evolving as our AI usage grows.
You will work directly with our IT Operations and Compliance leads, and you will integrate with our product engineering team as AI capabilities are embedded into our clinical and revenue cycle products.
This is a foundational hire. The person in this role will help determine how AI gets used across the entire organization.

AI Gateway Infrastructure

• Deploy, configure, and maintain a self-hosted AI gateway running on Azure App Services
• Implement routing logic, per-team and per-user rate limits, and budget kill-switch controls
• Manage model provider integrations across multiple AI APIs from a single gateway layer

PHI/PII Redaction Pipeline

• Build and maintain an NLP-based PHI detection and redaction layer that intercepts all prompts before routing to any external model provider
• Configure entity recognizers for healthcare-specific PHI patterns (names, MRNs, DOBs, diagnoses)
• Ensure fail-closed behavior — if redaction fails, the request does not proceed

Identity & Access

• Implement SSO federation via Azure Entra ID — all AI gateway access tied to existing corporate identity
• Configure cross-cloud IAM federation between Azure and AWS so model API access uses no long-lived static credentials
• Maintain IAM groups, access policies, and least-privilege controls across both cloud environments

Observability & Cost Management

• Deploy and maintain a self-hosted LLM observability platform on Azure Container Apps
• Build dashboards tracking usage by team, user, and cost center
• Configure tiered budget alerting with automated notifications and hard stops
• Maintain audit-grade API logs forwarded to our SIEM environment for compliance evidence

Product Integration

• Connect our AI gateway to workflows within our proprietary clinical platform (InCredibly) as AI features are developed
• Support the internal Intelligent Automation team in connecting their workflows to the AI infrastructure layer
• Serve as the internal expert on what is safe, compliant, and feasible when product teams propose AI features

Must-Have

• 3+ years of cloud infrastructure experience spanning Azure and AWS
• Hands-on Azure experience: App Services, Container Apps, Entra ID / SSO configuration
• AWS experience: IAM, OIDC federation, API access management, CloudTrail or equivalent audit logging
• Python proficiency — configuration, pipeline scripting, environment management
• Experience deploying or configuring open-source AI gateway or proxy tooling (LiteLLM or equivalent)
• Experience with NLP-based PII/PHI detection frameworks (Microsoft Presidio or equivalent)
• Experience self-hosting observability platforms (LangFuse, Langsmith, or similar)
• Comfort with HIPAA data handling requirements — you understand why data must not leave the environment unredacted

Strong Advantage

• Experience in a healthcare or regulated data environment
• Infrastructure-as-code experience (Terraform or Azure Bicep)
• Secrets management via Azure Key Vault or equivalent
• Prior exposure to HITRUST, SOC 2, or similar compliance frameworks from a technical evidence perspective
• Experience integrating AI capabilities into enterprise SaaS products

Who You Are

• You prefer precise, well-documented infrastructure over clever engineering
• You treat compliance constraints as design inputs, not afterthoughts
• You can explain what you built to a non-technical compliance officer and to a senior engineer — clearly, differently
• You have built things that ran in production without requiring constant hand-holding

Neolytix is at an inflection point — moving from a services company to a technology-enabled services company with proprietary platforms. The person in this role will be one of a small number of engineers who determine what that technology layer looks like. The work is real, the mandate is clear, and the infrastructure you build will be used in production by a healthcare company serving millions of patients.