Senior Data Engineer Lead

Scotiatech is a world-class engineering group! We are seeking to modernize bank technology by delivering a trustworthy, unique, and top-quality service.

We want you to be part of a Team that is always in personal and professional growth, for this reason we are looking for our new Senior Data Engineer Lead.

What will you do?

• Design, build, test, and optimize data pipelines and lakehouse solutions on Azure and Azure Databricks (Delta Lake, medallion architecture) to support scalable data products for International Banking.
• Act as the hands-on technical lead for assigned initiatives: own the end-to-end solution design, produce the technical documentation, and deliver production-grade code.
• Lead, mentor, and develop a team of Data Engineers, including work assignment, coaching, performance feedback, and participation in hiring; lead code and design reviews and promote a culture of engineering excellence, collaboration, and continuous improvement.
• Provide effort estimates, technical risks, and dependencies to support delivery planning, allocate work across the team, and keep the Director informed of progress and blockers.
• Collaborate with cross-functional partners (Data Scientists, Product Owners, Architecture, Platform Engineering, and Software Engineering) to translate business requirements into data products aligned with international business goals.
• Apply and help enforce best practices for data governance, security, and compliance within Azure environments, including Unity Catalog, role-based access control, data lineage, encryption, and key management.
• Monitor and maintain data pipelines to ensure high availability, data quality, cost efficiency (FinOps), and efficient processing across international markets.
• Champion the adoption of modern data engineering tools and methodologies, including ETL/ELT with Azure Data Factory and Databricks Workflows, dimensional and Data Vault modelling, DevOps/DataOps practices, and orchestration at scale.
• Troubleshoot and resolve complex data pipeline and platform incidents, performing root-cause analysis and implementing permanent fixes to meet agreed service levels.
• Support the migration and rationalization of legacy workloads (including existing Google Cloud Platform estates) onto the Azure Databricks target platform, minimizing business and regulatory risk.
• Evaluate and pilot new Azure and Databricks services and third-party tools, recommending adoption where they enhance data capabilities and support international expansion.

What do we offer you?

• Growth opportunities
• Diverse, dynamic and multicultural environment
• Benefits for your financial and emotional well-being
• competitive wages

What do we expect from you?

Education

• Bachelor’s degree in Computer Science, Data Engineering, Information Technology, or a related field.
• A Master’s degree is considered an asset.

Experience

• Strong verbal and written English communication skills (B2+ or higher).
• 5+ years of progressive hands-on experience in data engineering, including at least 3 years delivering production data solutions on Microsoft Azure and/or Azure Databricks.
• Demonstrated experience as a technical lead on complex data initiatives, including leading design and code reviews and directly supervising, coaching, and developing data engineers.
• Advanced proficiency in Python, PySpark, and SQL (Scala or Java an asset) for large-scale batch and streaming data processing, including performance tuning and cost optimization of Spark workloads.
• Strong working knowledge of CI/CD pipelines (Azure DevOps or GitHub Actions), version control (Git), Infrastructure as Code (Terraform or Bicep), automated testing, and Databricks Asset Bundles or equivalent deployment tooling.
• Knowledge of data governance, security, and compliance standards in cloud environments (e.g., GDPR, local data residency and privacy regulations), including Microsoft Entra ID, RBAC, and cloud key management.
• Experience migrating workloads from another public cloud or on-premises platform (e.g., GCP BigQuery/Dataflow to Azure Databricks) is a strong asset; Azure or Databricks certifications (e.g., Databricks Certified Data Engineer Professional, Azure DP-203) are an asset.
• Excellent problem-solving, influencing, and communication skills, with the ability to present complex technical concepts to non-technical stakeholders; Spanish language ability is an asset given the International Banking footprint.