Data Engineer

Summary of the role

As a Data Engineer you will be responsible for designing, developing and delivering solutions to load, optimise and transform data within our environment and the relevant infrastructure to support them.

The Data Engineer will provision, configure and implement Azure infrastructure consisting of SQL instances and other Fabric components as required to support the data needs of Diligenta.

You will be a key part of designing and building out our data infrastructure that will help to drive data insights, data use and value across the business.

Benefits

• 33 days including bank holidays
• Eligibility for an annual discretionary bonus scheme
• Personal and career development opportunities to progress your aspirations within the company and our global parent company (Tata Consultancy Services)
• Access to Perks at Work (an online discounted shopping platform) saving money on a wide range of goods and services
• Cycle to Work Scheme and interest‑free season ticket loans
• A company‑wide wellbeing programme, including an Employee Assistance Programme and other benefits/resources to support your mental, physical and financial wellbeing
• A comprehensive set of Moments That Matter policies, such as Carer’s Leave, Foster Leave and Retirement Leave
• A contributory company pension scheme with matching contributions up to 6%, group life assurance (Death in Service) and group income protection

What you’ll be doing

• Help build, implement and contribute to best practices within the engineering environment such as naming conventions, coding standards and design briefs
• Work to promote, implement and maintain clear code and documentation for all projects
• Maintain wiki entries for engineering, development and product environments
• Use CI/CD frameworks to iterate through and optimise solutions
• Use source control solutions to maintain our code base (GIT), maintaining code branches and release versions
• Work to deliver products and solutions utilising agile methodologies
• Help build and operate a content delivery network for solution delivery and maintenance
• Create solutions that comply with data governance frameworks and data management processes and policies
• Be an active part of product and change refinement processes to help define stories, features and contribute development estimates
• Be a key part of designing and building out our Fabric infrastructure that will help to drive data insights, data use and value across the business

What we’re looking for

• Prior experience in a similar Data Engineering role in either a software or data delivery environment
• Educated up to a degree level or equivalent experience
• Understanding of data governance concepts
• Strong analytical skills
• Familiarity with data privacy regulations such as GDPR
• Proven experience designing and implementing ETL/ELT solutions
• Knowledge of relational and non-relational data management systems
• Experience with big data platforms, tools and environments
• Experience with CI/CD tools and processes
• Proficiency in SQL and SSIS
• Experience working in an Agile delivery environment
• Experience with MS Fabric environment
• Experience with RDBMS platforms
• SQL coding skills
• Scrum or Kanban experience (desirable)
• Experience with Purview, Collibra, Erwin or similar (desirable)