Data Engineer
Idataraya Sdn Bhd · Kuala Lumpur, Malaysia ·
- Category
- Data engineering
Data engineer in Kuala Lumpur who builds the ingestion and transformation pipelines plus warehouse models that client reporting runs on, working against operational systems the company itself builds. Core work: SQL-based modeling, pipeline observability, and partnering with analysts.
You build the pipelines and warehouse models that client reporting runs on. The sources are operational systems we also build, so you can usually go and fix the cause.
What you will do
- Build ingestion and transformation pipelines from operational systems.
- Model the warehouse for how the business actually asks questions.
- Keep pipelines observable, so failures are noticed by us and not by the client.
- Work with analysts on what the numbers should mean.
What you will bring
- Commercial experience building data pipelines and warehouse models.
- Strong SQL and comfort with at least one orchestration tool.
- Understanding of incremental loads, late data and idempotency.
- Interest in the operational side, not only the data.