Databricks Data Engineer: Lakehouse & AI Analytics
INGEPSY · Barranquilla, Colombia ·
- Category
- Data engineering
A Data Engineer builds batch and streaming data pipelines on Databricks using PySpark and Delta Lake, migrating legacy data warehouse and ETL workloads into a governed medallion-architecture Lakehouse that powers analytics and AI use cases. Core tech: Databricks, PySpark, Delta Lake, SQL, Python, Unity Catalog.
AgileEngine is seeking a Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy data warehouse and ETL workloads onto a governed Lakehouse, modeling a medallion architecture that powers analytics and AI use cases.
Strong SQL, Python, and experience with Unity Catalog governance round out the role. The role involves designing and operating pipelines, optimizing Spark and Delta tables for performance, and collaborating with DevOps
#J-18808-Ljbffr