Lead Big Data Engineer: Databricks Lakehouse on Azure
SoftServe · Poland ·
- Seniority
- Lead
- Category
- Data engineering
Lead Big Data Engineer at SoftServe designing and building scalable batch and streaming data pipelines on the Databricks Lakehouse platform in Azure, using SQL and PySpark alongside services like Data Factory, Synapse, Data Lake, and DevOps, from PoC through production.
SoftServe is seeking a data engineer to design and develop scalable data solutions using the Databricks Lakehouse platform within Azure cloud environments. You will collaborate with technical and business stakeholders to deliver high-quality batch and streaming data pipelines, contribute to architectural decisions, and support projects from PoC to production.
You will work with Azure services such as Data Factory, Synapse, Data Lake, and DevOps, applying advanced SQL and PySpark to optimize data