Data Engineer

Data Engineer Job Description

A Data Engineer is a data professional who uses their expertise in data engineering and programming to build systems that collect, manage, and convert raw data into usable information for business analysts.

Requirements and skills

• Previous 7+ years of experience as a data engineer or in a similar role
• Technical expertise with data models, data mining, and segmentation techniques
• Knowledge of programming languages (e.g., Java and Python)
• Hands-on experience with SQL database design
• Great numerical and analytical skills
• Degree in Computer Science, IT, or similar field; a masters is a plus.
• Data engineering certification (e.g., IBM Certified Data Engineer) is a plus.
• Big data technologies such as Hadoop, Spark, and Kafka.
• Also be familiar with cloud platforms such as AWS, Google Cloud, and Azure.
• Should be proficient in SQL, Excel, Tableau, or other BI tools. They should also have a good understanding of statistical analysis and modelling techniques, as well as business acumen.

Responsibilities

• Analyse and organize raw data.
• Build data systems and pipelines.
• Evaluate business needs and objectives.
• Interpret trends and patterns.
• Conduct complex data analysis and report on results.
• Prepare data for prescriptive and predictive modelling.
• Build algorithms and prototypes.
• Combine raw information from different sources.
• Explore ways to enhance data quality and reliability.
• Identify opportunities for data acquisition.
• Develop analytical tools and programs.
• Collaborate with data scientists and architects on several projects.