Azure Data Engineer - Batch Pipelines (Guadalajara, MX)
Flextal Staffing · Guadalajara, Mexico ·
- Employment
- Full time
- Category
- Data engineering
- Experience
- 4+ years
- Visa sponsorship
- No
Flextal Staffing · Guadalajara, Mexico ·
MezTal · Jalisco, Mexico
Prometheus Federal Services · Fairfax, VA
EXL · Gurugram, Haryana, India
Surgery Partners · Nashville, Tennessee, United States
An Azure Data Engineer builds batch ingestion pipelines from EMR, claims, and CRM sources into a Medallion (Bronze/Silver/Gold) architecture for a health-tech startup, using Azure Data Factory, SQL, PySpark/Databricks, Synapse, Key Vault, and Purview, with a focus on data quality, lineage, and governance. Full-time, hybrid in Guadalajara, working U.S. Eastern Time hours.
A rapidly scaling Health-Tech startup is developing a next-generation platform to deliver an industry-leading consumer healthcare experience powered by AI. The Azure-native ecosystem supports telemedicine and telehealth web and mobile applications while redefining the company’s data, analytics, and AI foundation.
Role OverviewWe are seeking an experienced Azure Data Engineer to design and implement high-quality batch ingestion pipelines from key data sources (EMR, claims, CRM) into Medallion-zone architecture (Bronze, Silver, Gold). The role focuses on embedding data quality, lineage, and error handling within a metadata-driven, reusable framework that ensures scalability and transparency across the enterprise data platform.
Key Responsibilities• Build and optimize Azure Data Factory (ADF) pipelines, dataflows, and activities (Copy, Mapping Data Flows, Notebooks) for ingestion and ELT, leveraging Key Vault for secrets management.
• Implement schema drift handling, incremental loads, and retry/error notification patterns.
• Develop Silver/Gold transformations, conforming dimensions and KPIs according to business-defined semantic models.
• Apply data quality checks, publish metrics to monitoring dashboards, and lead issue remediation.
• Register and maintain assets in Microsoft Purview, ensuring data cataloging, PII classification, and RBAC alignment.
• Document pipelines, author operational runbooks, and actively participate in peer code reviews and on-call rotations.
• 2–3 data sources onboarded per quarter, each validated with signed-off data quality results and lineage diagrams.
• Parameterized pipelines with reusable templates and environment-aware configurations.
• Consistent delivery of reliable, compliant, and performant data pipelines supporting analytics and AI workloads.
• 4–7 years of hands-on experience in data engineering within Azure ecosystems.
• Strong command of ADF and SQL, with working knowledge of PySpark, Databricks, and Synapse.
• Experience implementing Medallion architecture (Bronze, Silver, Gold), partitioning strategies, and performance optimization.
• Familiarity with Purview, data governance, and data privacy standards (HIPAA or similar).
Location: Providencia, Guadalajara, Mexico
️ Language: Bilingual (English & Spanish)
Must be legally authorized to work and currently residing in Mexico.
⌚Full-Time | U.S. Eastern Time
At Meztal, we prioritize innovation, collaboration, and personal growth. You’ll have the opportunity to work on meaningful projects, be part of a supportive team, and enjoy a culture that values work-life balance and professional development.
EXL · Gurugram, Haryana, India