Senior Data Engineer

Overview

As a Senior Data Engineer in a disruptive FinTech, you will help build and evolve a Databricks-native data platform that supports large-scale data processing and data science workflows. You will work in a cross-functional team to deliver reliable, scalable ingestion, transformation, and platform capabilities, enabling data science and automated workflows. The role focuses on production engineering, platform reliability, and governance within Azure, with opportunities to shape the data foundation for ML and agentic processes. You’ll operate in an output-driven, collaborative environment with autonomy and continuous learning.

Responsibilities

• Develop and evolve Databricks-based data pipelines and platform capabilities
• Handle high-volume data ingestion and transformation across the stack
• Build production ETL/ELT pipelines
• Implement APIs, SFTP/FTPS data retrieval
• Contribute to CI/CD, automated testing and deployment processes
• Ensure platform reliability, monitoring and troubleshooting
• Manage Azure infrastructure, security and governance
• Support Data Science, ML, and agentic workflows
• Work within a cross-functional team to move toward a Databricks-native environment

Key requirements

• Databricks experience (essential)
• strong Python, SQL/Spark and ETL/ELT能力
• good knowledge of databases and data warehousing, incl. dimensional/Kimball
• understanding of platform, DevOps and systems engineering
• genuine technical curiosity
• STEM background beneficial but not essential

• collaboration
• curiosity
• autonomy
• Databricks
• Python
• SQL