Value Proposition
- Responsible for designing and building data pipelines for enterprise data through ETL/ELT processes.
- Develop and maintain large-scale data platforms, data lakes and cloud solutions.
Job Details
Position Title: Data Engineer II
Career Level: P2
Job Category: Senior Associate
Role Type: Hybrid
Job Location: Bangalore
About the Team:
The data engineering team is community of dedicated professionals committed to designing, building, and maintaining data platform solutions for the organization.
Impact
Enterprise data warehouse supports several critical business functions for the bank including Regulatory Reporting, Finance, Risk steering, and Customer 360. This role is vital for building and maintaining enterprise data platform, data processes, and to support business objectives. Our values — inclusivity, transparency, and excellence — drive everything we do. Join us and make a meaningful impact on the organization.
Key Deliverables
- Responsible for building and maintaining data platform that supports data integrations for Enterprise Data Warehouse, Operational Data Store or Data Marts etc. with appropriate data access, data security, data privacy and data governance.
- Create data ingestion pipelines in data warehouses and other large-scale data platforms.
- Create Data Ingestion pipeline for a variety of sources – File (Flat, delimited, Excel), DB, API (With Apigee integration), and SharePoint.
- Build reusable Data pipelines / frameworks using Python.
- Creating scheduled as well as trigger-based ingestion patterns using scheduling tools.
- Create performance optimized DDLs as per Logical Data Model.
- Performance tuning of complex data pipelines and SQL queries.
- Performs impact analysis of proposed changes on existing architecture, capabilities, system priorities, and technology solutions.
- Working in Agile Framework, participating in various agile ceremonies, co-ordination with scrum master, tech lead, and PO on sprint planning, backlog creation, refinement, demo, and retrospection.
- Working with Product Owners to understand PI goals, PI planning, requirement clarification, and delivery coordination.
- Technical support for production incidents and failures
- Work with global technology teams across different time zones (primarily US) to deliver timely business value.
Skills and Qualification (Functional and Technical Skills)
Functional Skills:
- Team Player: Support peers, team, and department management.
- Communication: Excellent verbal, written, and interpersonal communication skills.
- Problem Solving: Excellent problem-solving skills, incident management, root cause analysis, and proactive solutions to improve quality.
- Partnership and Collaboration: Develop and maintain partnership with business and IT stakeholders
- Attention to Detail: Ensure accuracy and thoroughness in all tasks.
Technical/Business Skills:
- Data Engineering:
- Experience in designing and building Data Warehouse and Data lakes. Good knowledge of data warehouse principles, and concepts.
- Strong knowledge of Snowflake data platform and solutions for enterprise level implementation
- Technical expertise of AWS cloud
- Data integration skills:
- Experience in design and development of complex data pipelines
- Technical expertise in ELT tools such as DBT and AWS Glue
- Expert in SQL
- Development experience in at least one scripting language (Python etc.), adept in tracing and resolving data integrity issues.
- Experience in data pipeline orchestration using Airflow
- Data Model: Knowledge of Logical and Physical Data Model using Relational or Dimensional Modeling practices, high volume ETL/ELT processes.
- Performance tuning of data pipelines and DB Objects to deliver optimal performance.
- Experience in Gitlab version control and CI/CD processes.
- Experience working in Financial Industry is a plus.
Relationships & Collaboration
- Reports to: Associate Director - Data Engineering
- Partners: Senior leaders and cross-functional teams
- Collaborates: A team of Data Engineering associates
Accessibility Needs
We are committed to providing an inclusive and accessible hiring process. If you require accommodations at any stage (e.g. application, interviews, onboarding) please let us know, and we will work with you to ensure a seamless experience.