Data Engineer

The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization’s data assets.

Job Responsibilities:

• Design, construct, install, test and maintain highly scalable data management systems.
  
• Ensure systems meet business requirements and industry practices.
  
• Design, implement, automate and maintain large scale enterprise data ETL processes.
  
• Build high-performance algorithms, prototypes, predictive models and proof of concepts.
  
• Build, test and maintain batch ETL pipelines for assigned datasets, following existing team patterns and standards.
  
• Implement changes to existing pipelines and tables in response to defined requirements, including backfills and schema updates.
  
• Write and optimise SQL for large-scale datasets; investigate and fix data quality issues raised through monitoring or stakeholder reports.
  
• Add and maintain data quality checks, tests and documentation for the pipelines in scope.
  
• Produce prototypes and exploratory analyses where requested, with direction from the FTE owner on scope and success criteria.
  
• Participate in code review and follow team conventions for version control, deployment and change management
  

Requirements

Benefits

• Competitive salary
  
• Healthcare contribution and inclusion in company pension scheme
  
• Work laptop and phone
  
• 25 days annual leave (pro-rata) plus paid bank holidays
  
• Expanding workforce with potential for career progression for top performers.