Data Engineer (Python / Databricks / Azure)

Project Description:

• Development of a sales planning and analytics platform for a premium German OEM in the Asia region, enabling data-driven business decisions through scalable data processing,integration, and API-based data consumption.

Responsibilities:

• Design and develop scalable data processing solutions using Python and Databricks


• Build and maintain data pipelines for ingestion, transformation, and aggregation of business data


• Develop REST APIs using FastAPI to expose data and analytical services to consuming applications


• Design and optimize SQL queries and data models


• Collaborate with business analysts, data engineers, and product stakeholders to translate business requirements into technical solutions


• Deploy and maintain solutions on Microsoft Azure


• Drive best practices in performance optimization, monitoring, testing, and code quality


• Mentor junior engineers and contribute to architectural decisions

Mandatory Skills Description:

• 5+ years of software/data engineering experience


• Strong Python development experience


• Hands-on experience with Databricks


• Strong SQL and data modeling skills


• Experience developing APIs with FastAPI


• Experience with Azure cloud services


• Understanding of ETL/ELT concepts and data pipeline design


• Experience with Git and CI/CD pipelines

Nice-to-Have Skills Description:

• Experience with Azure Data Factory


• Experience with Azure Synapse Analytics


• Knowledge of Spark/PySpark


• Experience building data products for Sales, Marketing, or Business Planning


• Exposure to machine learning workflows