Data Engineer

We are seeking an experienced Data Engineering Lead with a strong background. The ideal candidate will be responsible for end-to-end delivery of data solutions, platform reliability, and alignment with business objectives across portfolio, market, and investment data domains.

Key Responsibilities

Lead and manage the Data Engineering, ensuring successful project delivery and operational excellence.

Own end-to-end delivery of data engineering initiatives, maintaining SLA compliance and platform performance.

Collaborate with business stakeholders, portfolio management teams, and technology leadership.

Manage cross-team dependencies, risks, and escalations across multiple workstreams.

Design and oversee scalable data pipelines, data quality frameworks, and data platform solutions.

Ensure platform stability, monitoring, incident management, and production support readiness.

Drive best practices for reliability, availability, scalability, and operational governance.

Required Skills

Strong expertise in Databricks, Apache Spark, and performance tuning.

Hands-on experience with Apache Airflow/Astronomer for workflow orchestration and DAG design.

Extensive experience in Data Engineering, ETL/ELT, data quality, and scalable pipeline development.

Strong knowledge of DevOps, CI/CD, Infrastructure as Code (IaC), and automation.

Experience with platform administration, monitoring, alerting, and operational support.

Excellent leadership, stakeholder management, and communication skills.