Senior Databricks Engineer | Hybrid Data Platform Architect
INGEPSY · Colombia ·
- Seniority
- Senior
- Category
- Data engineering
AgileEngine seeks a Senior Data Engineer to build batch and streaming pipelines on Databricks with PySpark and Delta Lake, migrating legacy workloads to a governed Lakehouse using a medallion architecture. Day-to-day work spans SQL/Python, Unity Catalog governance, data quality, and collaboration with DevOps and analytics engineers on observability and compliance.
AgileEngine seeks a Senior Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy data workloads to a governed Lakehouse, modeling a medallion architecture powering analytics and AI use cases.
Strong SQL, Python, and Unity Catalog governance will round out the role. You will design pipelines, maintain data quality, and collaborate with DevOps and analytics engineers to ensure observability, security, and compliance while