Design and implement enterprise data platforms on Databricks, build ETL/ELT pipelines with Spark/PySpark/SQL, and provide technical leadership for data architecture and legacy migration projects.
- Build and optimize ETL ELT pipelines using Spark PySpark and SQL
- Define data architecture governance and security
- Design and implement enterprise data platforms on Databricks
- Migrate legacy data platforms to Databricks and cloud environments
- Optimize performance scalability and cost of data workloads
- Provide technical leadership for solution design and architecture