Sr Databricks Data Engineer
Pacer Group · Toronto, Canada ·
- Seniority
- Senior
- Category
- Data engineering
Senior data engineer leading the migration of legacy Cloudera/Hadoop platforms to a Databricks Lakehouse. Day to day involves building high-volume PySpark/Spark SQL ELT pipelines, designing Delta Lake/Medallion architectures, and optimizing workloads using finance and risk data models.
- Hands-on experience with Databricks and Apache Spark at scale.
- Lead modernization of legacy Cloudera (CDH/CDP, Hive, HBase, Impala, Spark) platforms to Databricks Lakehouse.
- Design and implement scalable Data Warehouse, Data Lake/Lakehouse, Delta Lake, and Medallion architectures.
- Develop high-volume PySpark/Spark SQL ELT pipelines and optimize Databricks workloads for performance and cost.
- Strong experience with Finance and Risk data models, including General Ledger, accounting, credit, liquidity, market risk, and regulatory reporting.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.