Data Engineer

Company Description

NCS is a leading AI Tech Services company. With a 15,000-strong team across the Asia Pacific, NCS scales its platforms and capabilities to provide clients with greater agility and AI expertise across a range of industries. Embracing a strong ecosystem of global partners, NCS transforms technology services delivery combining AI with digital resilience to drive real business impact. NCS is a subsidiary of the Singtel Group.

Duties and Responsibilities

• Design, build, and maintain scalable, secure data pipelines and storage systems; ensure data quality through ETL processes and regular checks.

• Implement policies and practices to control, optimize, and secure data assets, ensuring data integrity and accessibility.

• Develop and maintain data models, structures, and databases to meet business needs; communicate data architecture effectively.

• Develop, test, and maintain scripts and programs to automate data processing and pipelines, adhering to industry standards.

• Create and operationalize data visualization solutions to simplify complex data for stakeholders and decision-making.

• Work with cross-functional teams to gather data requirements, optimize existing processes, and deliver ad hoc reports and insights

• Knowledge

  – Knowledgeable in the following:

  • Comprehensive understanding of data manipulation tools such as pandas, dplyr, and Spark.

  • In-depth knowledge of big data frameworks and tools like Apache Spark and Hadoop.

  • Familiarity with data warehousing services like AWS Redshift, Snowflake, or similar solutions.

  • Proficiency in AWS Cloud Services, particularly AWS Glue and AWS Lake Formation.

  • Familiarity with business intelligence tools such as Tableau, Power BI, QuickSight, or Google Data Studio.

  • Awareness of data visualization libraries and packages like Dash, Plotly, Matplotlib, ggplot, and Folium.

  • Understanding of machine learning libraries and tools (e.g., scikit-learn, caret, MATLAB) is a plus.

  • Knowledge of data governance, quality control, and security best practices.

  • Python, SQL, Data flows/ETL

  • Snowflake, BigQuery, GCP

• Skills

  • Problem-Solving: Ability to address technical challenges and deliver efficient data solutions.

  • Communication: Clear and concise communication skills for collaborating with team members and stakeholders.

  • Collaboration: Ability to work effectively within a team environment to achieve shared goals.

  • Time Management: Capacity to manage tasks and meet deadlines in a structured and timely manner.

  • Attention to Detail: Careful and accurate handling of data to ensure quality and integrity.

  • Client-Focus: Ability to understand business needs and align data solutions to support decision-making and strategic objectives.

  • Adaptability: Flexible and open to learning new tools, technologies, and processes in a rapidly changing environment.