Senior Databricks Data Engineer: Lakehouse & Streaming
INGEPSY · Cartagena, Colombia ·
- Seniority
- Senior
- Category
- Data engineering
Senior Data Engineer at AgileEngine in Cartagena, Colombia, building batch and streaming pipelines on Databricks with PySpark and Delta Lake, migrating legacy workloads to a governed Lakehouse using a medallion architecture for analytics and AI. Strong SQL/Python and Unity Catalog governance are core to the role.
AgileEngine in Cartagena, Colombia, seeks a Senior Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy workloads to a governed Lakehouse while modeling a medallion architecture that powers analytics and AI use cases.
Strong SQL and Python, plus Unity Catalog governance, complete the profile. The role emphasizes data quality, observability, and collaboration with DevOps and analytics teams to ensure scalable, secure data
#J-18808-Ljbffr