Azure Databricks Architect
Compunnel Inc. · Toronto, Jefferson County ·
- Category
- Architecture
Architects and builds enterprise data lake and lakehouse solutions on Azure and Databricks, developing scalable pipelines with Azure Data Factory, Data Lake Storage, Python, PySpark, and SQL, while implementing CI/CD with Jenkins/GitHub and applying Databricks FinOps practices for cost-efficient data platforms.
Key Responsibilities Design and set up enterprise data lake and lakehouse solutions using Azure and Databricks Develop and implement scalable data solutions using Azure Data Factory, Azure Data Lake Storage, and Databricks Develop complex data processing and transformation solutions using Python, PySpark, and SQL Design and implement CI/CD processes using tools such as Jenkins and GitHub Apply lakehouse architecture and Databricks FinOps practices to support efficient and cost-effective data pl…