Senior Data Engineer
OEC · Oggiyamduraipakkam, TN, IN ·
- Seniority
- Senior
- Category
- Data engineering
- Experience
- 6+ years
OEC · Oggiyamduraipakkam, TN, IN ·
Job Title: Sr. Data Engineer
Department: Data Engineering Location: Chennai
Position Overview
The Senior Data Engineer is responsible for delivering scalable data pipelines, ETL processes, data warehouse solutions, and BI reporting tools across Azure and AWS cloud platforms. This role serves as a key technical contributor, ensuring seamless data integration, high data quality, and secure access while collaborating with stakeholders to translate business needs into efficient, cloud-optimized data solutions.
Key Responsibilities
Design, build, and maintain scalable data pipelines and ETL processes including database scripts, stored procedures, triggers, functions, Azure Data Factory pipelines, AWS Glue jobs, and other back-end processes to ensure efficient data extraction, transformation, loading, and seamless system integration across Azure and AWS cloud environments.
Own the design, development, and maintenance of enterprise BI and reporting solutions including metrics, reports, analyses, and dashboards using tools like Amazon QuickSight and Microsoft Azure BI solutions to drive key business decisions; implement robust user access controls and data security measures across cloud environments.
Assist with tabular and multi-dimensional modelling in addition to the development and maintenance of the Enterprise Data Warehouse leveraging both AWS and Azure cloud data warehouse solutions.
Coordinate with management and end-users to evaluate business needs, anticipate opportunities for improvement in cross-cloud analytics solutions, identify alternate approaches that leverage the strengths and cost-optimization benefits of both AWS and Azure platforms, and present recommendations for approval and implementation.
Develop and execute comprehensive system and unit testing across Azure and AWS environments, identify and fix defects, and validate results to ensure quality and compatibility between cloud platforms.
Skills & Qualifications
Must-Have:
6 -10 years of experience in data engineering and reporting required.
A bachelor’s degree from an accredited college or university is required, with a focus in Information Technology, Computer Science, or related discipline.
Strong proven track record of developing and testing database scripts, stored procedures, triggers, functions, SSIS Packages, AWS, Azure cloud services and other back-end processes to support system integration.
Experience using BI/Analytics/Statistical tools like Power BI, Tableau, SSRS, SSAS, and Excel.
Strong SQL skills, business intelligence tool expertise, AWS Cloud services, and report development skills.
Hands-on experience with Azure cloud services including Azure Data Factory, Azure SQL, Azure Blob Storage, Azure Dataflow, Logic Apps, Azure Synapse Analytics, Function Apps, and Key Vaults for building and orchestrating data pipelines, serverless integrations, and secure secrets management.
Hands-on experience with AWS cloud services including S3, Lambda, Glue, Step Functions, Redshift, Athena, SNS, SQS, EventBridge, Event Bus, SageMaker, IAM, Secrets Manager, Bedrock, CloudWatch, and Lake Formation for building scalable data engineering solutions, event-driven architectures, ML workflows, and governance of data lakes.
Understanding of configuration, deployment, and database servers.
Strong writing and verbal communication skills. Ability to work collaboratively in a functional team environment.
Preferred:
Domain expertise in Automotive industry.
Certification in AWS or Azure services.