Senior Data Engineer (contract)

Senior Data Engineer (contract)

Responsibilities:

• Perform data extraction, cleaning, transformation, and flow. Web scraping may be also a part of the work scope in data extraction.
• Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines with data processing frameworks
• Collaborate with Project Manager, Visualisation Developer, Data Scientist, UX Designers and Data Analyst to build scalable data-driven products
• Work in an Agile Environment that practices Continuous Integration and Delivery
• Support and advise best practices in data management standards, policies and procedures
• Work closely with fellow developers through pair programming and code review process

Requirements:

• Interest in being the bridge between engineering and analytics
• Knowledge about system design, data structure and algorithms
• Familiar with data modelling, data access, and data storage infrastructure like Data Mart, Data Lake, and Data Warehouse
• Proficient in general data cleaning and transformation (e.g. SQL, pandas, R, etc)
• Familiar with rest API and web requests/protocols in general
• Proficient with processing data from open-standard file format or data interchange format (e.g. XML, JSON)
• Good in building ETL pipeline (eg. Talend Data Integration, Informatica PowerCenter, IBM DataStage, SAS Data Integration)
• Good in database design and various databases (e.g. MS SQL Server, Oracle RDBMS, IBM DB2, Postgres etc)
• Comfortable in at least one scripting language (eg. Python)

Only shortlisted candidates will be notified.

-----------------------------------------------------------------------------------------------------------------------------------

EA License Number: 10C3636
EA Personnel Name: Arora, Hardeep
EA Personnel Registration Number: R1111454

By submitting your resume and cover letter to apply for our job opening, you confirm that you have read the Data Protection Notice for Job Applicants (https://www.nsearchglobal.com/dp-notice/job-applicants) and you consent to the collection, use, and disclosure of your personal data for the purpose of verifying and evaluating your job application. Additionally, you have to notify and obtain consent from all individuals listed as your references to their data being collected and disclosed for the purposes related to your job application