Data Engineer
Aetherion Dataworks Sdn. Bhd. · Malaysia ·
- Category
- Data engineering
- Experience
- 1+ years
Aetherion Dataworks Sdn. Bhd. · Malaysia ·
Builds and optimizes ETL data pipelines, integrates data from various sources via APIs into Snowflake, manages and tunes the Snowflake warehouse, and supports Tableau dashboards for the Data Science & AI team. Core stack: Snowflake, Python, SQL, APIs, Tableau.
We are looking for a skilled Data Engineer to join our Data Science & AI team. In this role, you will be responsible for building and optimizing data pipelines, integrating various data sources, and supporting our data analytics capabilities using technologies such as Snowflake, Python, SQL, APIs, and Tableau. This position offers the opportunity to play a pivotal role in shaping our data infrastructure and ensuring seamless data flow across the organization.
A dynamic and fast-paced environment where effective team players thrive.
Opportunities for professional and personal development.
Comprehensive training and ongoing coaching to ensure your success.
Design, Develop, and Optimize Data Pipelines: Build scalable ETL processes using Snowflake, Python, and SQL to handle large volumes of data efficiently.
Data Integration: Extract, transform, and load data from various sources using APIs and other integration tools to consolidate data into our data warehouse.
Database Management and Optimization: Manage and fine-tune Snowflake databases to ensure high availability, performance, and data integrity.
Data Visualization Support: Collaborate with the BI team to create insightful dashboards and reports using Tableau, supporting data-driven decision-making.
Cross-Functional Collaboration: Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver scalable solutions.
Documentation and Best Practices: Develop comprehensive documentation for data processes, pipelines, and best practices to enhance system reliability.
1+ years of experience in data engineering, data warehousing, or a related field.
Bachelor’s degree or higher in Computer Science, Data Engineering, or a related field.
Strong proficiency in Python, SQL, and experience with API integrations.
Hands-on experience with Snowflake and Tableau.
Solid understanding of ETL processes, data architecture, and pipeline optimization.
Proven ability to work with large datasets and ensure data quality and scalability.
Strong analytical and problem-solving skills with an eye for detail.
Excellent communication skills and a collaborative mindset.
Experience with cloud platforms such as Snowflake, AWS or Google Cloud Platform (GCP).
Familiarity with data streaming technologies (e.g., Kafka, Apache Spark).
Understanding of data governance, privacy, and compliance standards.