What Youll Be Doing (position summary):
The Data Engineer is responsible for designing, developing, and maintaining scalable data solutions using cloud technologies. This role leverages expertise in Azure Data Factory, Azure Databricks, and Power BI to build and optimize data pipelines and analytics solutions. The incumbent works with large data sets utilizing Python, PySpark, and SAS, and applies sound data modeling principles to enable effective data management and reporting. The role ensures the quality and reliability of data products through the creation of unit test cases and supports the implementation of data mesh architecture within the cloud infrastructure.
At CIBC India we enable the work environment most optimal for you to thrive in your role. Details on your work arrangement (including on-site and remote work) will be discussed at the time of your interview.
How Youll Succeed (responsibilities):
Data Engineering and Solution Delivery:
- Develop, implement, and maintain robust data pipelines and workflows using Azure Data Factory and Azure Databricks to support business analytics and reporting needs.
- Design and optimize solutions for processing large data sets leveraging Python, PySpark, and SAS to improve scalability, performance, and reliability.
- Integrate diverse data sources and apply sound data modeling and validation techniques to support effective data management and reporting.
- Apply knowledge of cloud infrastructure, lakehouse concepts, medallion architecture, and data mesh principles to design scalable and resilient data solutions.
Reporting and Analytics:
- Build and maintain Power BI dashboards and reports to deliver actionable insights to business stakeholders.
- Translate reporting and analytics requirements into scalable cloud-based data solutions that support business decision-making.
- Ensure the accuracy, consistency, and reliability of reporting outputs through effective engineering and testing practices.
- Support the ongoing enhancement of analytics solutions to meet evolving business needs.
Data Quality, Testing, and Support:
- Create and execute comprehensive unit test cases to ensure the reliability and accuracy of data products and solutions.
- Troubleshoot and resolve data issues to support stable and effective data operations.
- Monitor and maintain data pipeline performance to minimize disruptions and improve operational efficiency.
- Ensure adherence to best practices in cloud data engineering, security, and technical standards.
Collaboration and Stakeholder Partnership:
- Collaborate with business analysts, data scientists, and IT teams to gather requirements and deliver effective data solutions.
- Work closely with cloud infrastructure and architecture teams to ensure alignment with organizational standards and target architecture.
- Partner with external vendors as required for tool integration, support, and issue resolution.
- Contribute ideas and recommendations that drive innovation and continuous improvement in data engineering practices and technology operations.
CROSS-FUNCTIONAL RELATIONSHIPS:
- This job collaborates with business analysts, data scientists, and IT teams to gather business and technical requirements and translate them into scalable data solutions.
- This job works closely with cloud infrastructure and architecture teams to ensure solutions align with enterprise standards, security requirements, and cloud best practices.
- This job interacts with business stakeholders to support analytics, reporting, and data product delivery.
- This job partners with external vendors as required for tool integration, technical support, and platform optimization.
COMPLIANCE REQUIREMENTS/RESPONSIBILITIES:
As an employee of CIBC, the incumbent must comply with all applicable CIBC and Line of Business policies, standards, guidelines and controls.
AUTHORITIES/DECISION RIGHTS :
As a key contributor to the business unit, this job has the authority to recommend changes to business processes in order to enhance operational efficiency and effectiveness.
JOB DIMENSIONS:
- Accountable for developing, implementing, and maintaining cloud-based data pipelines, workflows, and reporting solutions.
- Supports large-scale data processing and integration across diverse data sources using Azure cloud technologies.
- Contributes to the delivery of analytics and reporting capabilities through Power BI and modern cloud data platforms.
- Works across multiple stakeholder groups including business analysts, data scientists, IT teams, architecture teams, cloud infrastructure teams, and external vendors.
- Supports data quality, testing, issue resolution, and the ongoing improvement of cloud data products and services.
Experience: 5+ years of experience
Who You Are (skills/qualifications):
Bachelors degree in computer science, Engineering, Information Technology, or a related
Must Have Skills:
- 5+ years of hands-on experience with Azure Data Factory, Azure Databricks, Power BI, and Unity Catalog.
- Solid understanding of cloud infrastructure and data mesh architecture.
- Experience in data modeling and integration of diverse data sources.
- Ability to create and execute unit test cases for data solutions.
- Excellent analytical, problem-solving, and communication skills.
- Technical Knowledge-Azure Data Stack,Azure,Azure Data Factory (ADF),Azure Databricks,Unity Catalog,Power BI,Medallion Architecture,Data Mesh,Lakehouse Architecture,Azure Data Lake Storage (ADLS),Data Lake technologies
Good to Have:
- Proficiency in handling large data sets using Python, PySpark, and SAS.
- Experience with big data platforms and cloud infrastructure.
- Exposure to Data Mesh Architecture and AI frameworks.
- Ability to drive innovation and continuous improvement in technology operations.
About CIBC:
CIBC is a leading North American bank, with a history of more than 150 years of living our purpose - to help make your ambition a reality. Client relationships are at the centre of our strategy, and our growth is enabled by a highly engaged and connected global team. From digital banking to community impact, were proud to drive progress for our clients and our communities. Recognized for our culture, award-winning innovation and community investment, CIBC continues to evolve by putting people and progress at the centre of everything we do.
About CIBC India:
CIBC India is a technology and operations hub in Hyderabad, where youll be part of our highly engaged and global team, and play a central role in supporting our growth. Whether youre driving innovation in digital banking or streamlining client onboarding, youll be part of a culture recognized for excellence and investment in people. At CIBC India, people and progress are at the centre of what we do: youll develop skills, collaborate with industry leaders, and see your ideas realized in a culture that values progress and belonging. We provide cutting-edge resources, ongoing learning, and a supportive environment where people come first. If youre ready to create meaningful change and build your future, CIBC India is where your ambition meets opportunity.
What CIBC India Offers:
At CIBC India, your goals are a priority. We start with your strengths and ambitions and strive to create opportunities to tap into your potential. We aspire to give you a career that goes well beyond your compensation.
- We work to recognize you in meaningful, personalized ways including competitive fixed pay, performance-based incentive programs, a family-first benefits program, employer contributions for your retirement, attractive time off and leave offerings, wellbeing support, and MomentMakers, our social, points-based recognition program
- Our spaces and technological toolkit will make it simple to bring together great minds to create innovative solutions that make a difference for our clients worldwide
- We cultivate a culture where you can express your ambition through initiatives like Purpose Day, a paid day off dedicated for you to use to invest in your growth and development