A Data Engineer who builds and optimises scalable data pipelines and ETL processes in Azure Databricks, designs data models in Databricks and Azure SQL, and prepares data for Power BI reporting and analytics while ensuring quality, monitoring, and cost-efficient use of the Azure platform.
As a Data Engineer at UPP you will build and optimise scalable data pipelines in a modern Azure Databricks environment to underpin BI, analytics and reporting. You’ll collaborate with stakeholders across the business to translate data needs into reliable data models and efficient ETL processes. The role sits in the Data & Business Intelligence team, supporting a data-driven approach and evolving the data platform for better decision making. This is an opportunity to work with cutting-edge cloud tech while contributing to a mission-driven, collaborative culture.
Pay / Benefits
discretionary performance bonus
29 days holiday plus bank holidays
private healthcare
pension
enhanced family leave policy
life assurance | virtual GP service? (listed together)
Responsibilities
Build, maintain and optimise scalable data pipelines and ETL processes using Azure Databricks
Collaborate with stakeholders to understand data requirements and deliver practical solutions
Ensure data quality, accuracy and consistency through validation and monitoring
Design and maintain data models in Databricks and Azure SQL
Transform and prepare data for reporting, analytics and BI
Support Power BI reporting and dashboards with the BI team
Manage and optimise Azure and Databricks resources for performance and cost efficiency
Implement monitoring, security and compliance controls across the data platform
Maintain documentation and support continuous improvement of data engineering processes
Contribute to innovation, knowledge sharing and best practice within the team
Key requirements
Experience building and managing data pipelines and ETL processes
Strong SQL skills and data modelling experience
Experience integrating data from multiple structured and unstructured sources
Strong understanding of cloud-based data architecture
Excellent analytical, problem-solving and troubleshooting abilities in fast-paced environments
Experience with Azure, Databricks or similar cloud data platforms
Proactive approach with a passion for continuous improvement and delivering high-quality data solutions
Collaborative and customer-focused mindset with a drive for improvement and delivering value