Lead Data Engineer

Overview

In this role you will drive cloud-based data platform work at Delta Lakehouse, delivering feature development, issue resolution, and monitoring within an agile team. You will lead architectural decisions, mentor engineers, and establish standards and reusable frameworks to advance the data platform. The position focuses on building scalable data solutions in a SCRUM/Kanban environment, with a strong emphasis on data quality and release discipline. This is a hands-on, leadership-focused engineering role.

Responsibilities

• Feature development and issue resolution on a cloud delta lakehouse platform
• Daily monitoring within an agile team and participation in ceremonies
• Lead architectural decisions and mentor junior engineers; establish standards, docs, and reusable frameworks

Key requirements

• 10+ years in data engineering
• 5+ years in data warehouse solutions
• Ability to lead complex data initiatives and make architectural decisions
• Experience with agile delivery methods (SCRUM/Kanban)
• Ownership of data issues and root cause analysis; remediation via code/data changes
• Knowledge of data warehouse testing and QA processes
• Understanding of Git branching strategies
• Knowledge of Azure DevOps release management
• Strong concise communication to drive alignment and collaboration within teams

• strong communication
• collaboration
• leadership and mentoring
• Delta Lake
• PySpark
• Spark SQL