Job Description – Data Engineer
Position: Data Engineer
Experience: 5+ Years
Location: Pune/ Indore/Kolkata/ Bangalore
Notice Period: Immediate Joiner
Employment Type: Full-Time
Role Overview
We are looking for an experienced Data Engineer with 5+ years of hands-on experience in designing, developing, and maintaining scalable data pipelines and ETL solutions. The ideal candidate should have strong expertise in AWS or Azure, ETL, SQL, and Python, along with working knowledge of GCP.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Develop data integration solutions using AWS or Azure cloud services.
- Write complex and optimized SQL queries for data extraction, transformation, and analysis.
- Develop and maintain data processing solutions using Python.
- Work with structured and semi-structured data from multiple sources.
- Perform data transformation, cleansing, validation, and quality checks.
- Monitor and troubleshoot data pipelines and resolve production issues.
- Collaborate with Data Architects, Developers, Analysts, and other stakeholders.
- Ensure data pipelines are scalable, reliable, secure, and optimized for performance.
- Support cloud-based data platform development and migration initiatives.
Required Skills
- 5+ years of experience in Data Engineering.
- Strong hands-on experience with ETL/ELT processes.
- Strong SQL skills, including query optimization.
- Good hands-on experience with Python for data engineering.
- Strong experience with GCP, AWS or Azure.
- Understanding of Data Warehousing and Data Modeling concepts.
- Experience working with large-scale data and production data pipelines.
Good to Have
- Experience with AWS Glue / S3 / Lambda / Redshift.
- Experience with Azure Data Factory / Azure Data Lake / Synapse.
- Knowledge of GCP BigQuery / Cloud Storage / Dataflow.
- Experience with Apache Spark / PySpark.
- Knowledge of Airflow or other workflow orchestration tools.
- Exposure to Git, CI/CD, Docker, or cloud-native technologies.
Candidate Profile
- Strong problem-solving and analytical skills.
- Good communication and stakeholder management skills.
- Ability to work independently and as part of a technical team.
- Experience working in enterprise production environments.