Data Engineer
Milestone Technologies Inc · Hyderabad, IN ·
- Work mode
- Remote
- Category
- Data engineering
The Data Engineer will aggregate data from multiple sources, design data quality controls, and maintain data pipelines. The role involves using Azure DevOps for CI/CD and applying Kimball dimensional modeling techniques.
- Aggregate data from multiple sources
- Analyze data pipelines for improvements
- Build automated data quality measurement processes
- Build data load error monitoring
- Build data transmission failure monitoring
- Collaborate on Kimball dimensional modeling
- Design data quality controls
- Develop analytical tools for data quality reporting
- Profile data sources for ETL issues
- Support data pipeline POCs
- Tune CI CD pipelines in Azure DevOps