Senior Azure Data Engineer

Greetings from TCS!

Job Title: Senior Data Engineer (Azure/SSIS)

Location: PAN INDIA

Experience Range: 7-14 years.

Required Skillset:

1. Minimum 6 yrs of experience in building ETL pipeline using Azure data Factory, Azure Synapse
2. Minimum 6 yrs of ETL development using PL/SQL
3. Exposure in Azure data brick is added advantage
4. Above average communication skill
5. should be willing to work as an individual contributor and experience of managing client delivery independently.

Job Description

Must-Have:

• Significant experience in Software Development and Agile Methodologies.
• Excellent experience in developing ETL routines, processes and structures.
• Expert in SSIS and Azure Synapse ETL development.
• Significant experience in developing Python or pySpark.
• Proven ability to set up Azure Synapse connectors (On-prem file shares, SFTP, SQL database, HTTP, etc..) in real world enterprise environment.
• Significant experience in Database and Data Storage Platforms including Azure Data Lake.
• Excellent experience in developing ETL routines, processes and structures.
• Extensive knowledge of data modelling techniques and structures.
• Practical experience of developing ETLs for Dimensions and Fact Tables including SCD I and II implementation.
• Excellent experience of deploying solutions in a fast-moving enterprise.
• Ability to validate engineering data and deploy solutions. Experience in incident, change management and transition processes
• Creating data catalogues
• Identifying Critical Data Elements
• Recording data quality business rules
• Carrying our data quality assessments
• Creating data quality assessment scripts & ETLs
• Creating data quality reports
• Designing & implementing Conceptual, Logical, and Physical data models
• Designing & implementing Relational data models with normalisation
• Designing & implementing Dimensional Data Models (Dimensions, Facts, SCD I, SCD II, SCD III)
• Designing & implementing Lakehouse and Delta Lake architectures
• Reporting, documentation/writing.
• Excellent Organisational skills.
• Experience with a wide range of IT environments, platforms and applications
• IT Qualification - Degree or equivalent work experience
• Professional certifications e.g. MCSE

Key Responsibilities:

• understanding business requirements relating to business data sources with the ability to integrate it and/ or transform it effectively in accordance with business needs
• the customisation and development of Extract Transform and Load routines, modelling, queries, reports and analysis
• the support of existing data marts, warehouse process chains and associated models and queries,
• Facilitating the follow up meetings and removing obstacles that affect the team
• ensuring the successful delivery of all assigned Data Engineering work on projects. across all ESB business units and their successful deployment to production, including use cases developed by our Data Science & Analytics team,
• Implement changes (CR’s) or new developments relating to existing data warehouses
• tracking project status and managing the project teams to mitigate issues and risks

Thanks & Regards,

Ria Aarthi A.