Senior Data Engineer - AWS/Databricks
Enable Data Technologies · Hyderabad ·
- Seniority
- Senior
- Category
- Data engineering
- Experience
- 8+ years
Enable Data Technologies · Hyderabad ·
Total Experience : 8+ Years
Notice Period : Immediate Joiner
Location : India (Remote)
We are seeking a Senior, hands-on Data Engineer to design, develop, and deploy enterprise data pipelines and data products using AWS, Databricks, and Medallion Architecture. The ideal candidate will have deep technical expertise in Databricks and AWS and be comfortable working hands-on across the full data engineering lifecycle.
Key Responsibilities :
- Design, develop, and deploy Bronze, Silver, and Gold data pipelines using Medallion Architecture.
- Build scalable data products using Databricks and AWS Glue.
- Develop complex data transformations and pipelines using Python, PySpark, and SQL.
- Implement and manage Databricks Unity Catalog for data governance, security, and access control.
- Develop and deploy Databricks workloads using Databricks Asset Bundles (DABs).
- Utilize AWS S3 and other AWS services to support enterprise data platforms.
- Implement CI/CD pipelines using GitHub Enterprise and GitHub Actions.
- Optimize data pipelines for performance, reliability, scalability, and cost.
- Collaborate with data architects, engineers, analysts, and business stakeholders to deliver data products.
- Participate in Agile development practices, sprint planning, code reviews, and technical discussions.
- Troubleshoot production data pipelines and resolve complex technical issues.