🚀 Hiring: Azure Data Engineer
We are looking for an experienced Azure Data Engineer to join our team and work on large-scale data engineering, cloud data platforms, data warehousing, analytics, and big-data initiatives.
The ideal candidate will have strong hands-on experience with the Microsoft Azure Data Engineering ecosystem, including Azure Data Factory, Azure Databricks, Azure Blob Storage, Apache Spark, SQL, Snowflake, ETL/ELT, Data Warehousing, DataOps, and CI/CD.
Key Responsibilities
- Develop prototypes, proof-of-concepts, and technical solutions using multiple data sources, AI/ML methods, and big-data technologies.
- Design, develop, implement, and deploy scalable data platforms and databases across cloud infrastructures.
- Build and optimize data pipelines for structured and unstructured data.
- Port and migrate data across different data sources, databases, and platforms to improve performance, scalability, accessibility, and analytics capabilities.
- Develop technical solutions that combine disparate data sources to generate meaningful business insights.
- Work closely with Data Architects, Data Scientists, BI teams, and business stakeholders to deliver enterprise data solutions.
- Design and implement robust ETL/ELT pipelines and data processing workflows.
- Process and manage large-scale datasets, including multi-terabyte data environments.
- Develop data processing solutions using Azure Databricks and Apache Spark.
- Implement data warehousing solutions using Snowflake and apply appropriate data modelling techniques.
- Implement and maintain data quality, data governance, and data transformation processes.
- Monitor data pipelines, identify bottlenecks, troubleshoot failures, and continuously improve pipeline performance.
- Contribute to DataOps, workflow orchestration, monitoring, automation, and CI/CD initiatives.
- Support analytics and machine-learning applications by developing reliable and scalable data processing workflows.
- Collaborate with globally distributed teams and stakeholders to understand requirements and deliver technical solutions.
- Stay current with emerging cloud, big-data, analytics, and data engineering technologies and identify opportunities for innovation.
Required Technical Skills & Experience
Azure Data Engineering
- 4+ years of professional experience in Data Engineering / Data Platform development.
- Strong hands-on experience with the Azure Data Engineering ecosystem.
- Excellent knowledge of:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Blob Storage
- Apache Spark
- Azure-based data storage and processing services
- Experience designing and implementing scalable cloud-based data architectures.
SQL & Databases
- Strong expertise in SQL and relational database technologies.
- Experience with T-SQL, Microsoft SQL Server, Oracle, or equivalent technologies.
- Strong understanding of relational database design.
- Experience processing and managing large-scale datasets, including multi-TB environments.
- Experience with database migration, optimization, performance tuning, and data integration.
Data Warehousing
- Strong experience with Snowflake.
- Excellent understanding of:
- Data Warehousing
- Data Modelling
- Star Schema
- Snowflake Schema
- Fact and Dimension Tables
- ETL/ELT Architecture
- Slowly Changing Dimensions
- Data Warehouse Design Principles
ETL / Data Transformation
- Strong understanding of Extract, Transform & Load (ETL/ELT) concepts.
- Hands-on experience developing complex data transformation pipelines.
- Experience integrating data from multiple heterogeneous sources.
- Ability to optimize data pipelines for performance, reliability, and scalability.
Big Data & Distributed Processing
- Strong interest and hands-on experience in Big Data technologies.
- Experience with Apache Spark and Azure Databricks.
- Ability to design and implement distributed data processing workflows.
- Experience working with large volumes of structured and unstructured data.
DataOps / DevOps
- Good understanding of DataOps and data orchestration.
- Experience with workflow management, pipeline monitoring, logging, and alerting.
- Understanding of CI/CD practices for data engineering solutions.
- Ability to identify opportunities for automation and process improvements.
BI / Analytics
Experience with at least one BI or reporting platform such as:
- Power BI
- Tableau
- Qlik
- SAS Visual Analytics
- Other enterprise BI/reporting platforms
Education
- Bachelor's or Master's degree in Computer Science, Computer Engineering, Information Technology, Data Engineering, or an equivalent discipline.
- Professional certification/degree in Data Science, Data Engineering, Cloud Computing, or related fields will be an advantage.
Required Soft Skills
- Strong analytical and problem-solving abilities.
- Excellent attention to detail and commitment to data quality.
- Strong planning and organizational skills.
- Excellent written and verbal communication skills.
- Ability to collaborate effectively with global teams and stakeholders.
- Comfortable working independently as well as in a team environment.
- Strong ownership and accountability.
- Curious mindset with an interest in learning and adopting emerging technologies.
- Ability to translate complex technical requirements into practical data engineering solutions.
#Hiring #JobOpening #CareerOpportunity #AzureDataEngineer #DataEngineer #DataEngineering #Azure #MicrosoftAzure #AzureDataFactory #ADF #AzureDatabricks #Databricks #ApacheSpark #Spark #Snowflake #SnowflakeDeveloper #SQL #TSQL #SQLServer #Oracle #ETL #ELT #DataPipelines #DataIntegration #DataMigration #DataTransformation #DataWarehouse #DataWarehousing #DataModeling #DataModelling #StarSchema #SnowflakeSchema #BigData #BigDataEngineering #BigDataAnalytics #CloudData #CloudDataEngineering #CloudComputing #CloudEngineering #DataArchitecture #DataArchitect #DataPlatform #DataPlatforms #DataOps #DataOpsEngineering #DevOps #CICD #DataGovernance #DataQuality #DataAnalytics #Analytics #BusinessIntelligence #BI #PowerBI #Tableau #Qlik #SAS #MachineLearning #ML #AIML #DataScience #DataScientist #DataTechnology #ModernDataStack #DataLake #DataLakehouse #Lakehouse #AzureCloud #AzureJobs #AzureCareers #DatabricksJobs #SnowflakeJobs #DataEngineeringJobs #DataJobs #TechJobs #ITJobs #CloudJobs #EngineeringJobs #TechnologyJobs #SoftwareJobs #HiringNow #NowHiring #OpenToWork #TechHiring #ITHiring #Recruitment #TechRecruitment #DataTalent #DataProfessionals #DataCareer #TechCareers #CareerInTech #CloudCareers #DataDriven #EnterpriseData #EnterpriseTechnology #DigitalTransformation #Technology #InformationTechnology #ITCareers #GlobalHiring #GlobalJobs