Big Data Engineer - Spark/Flink (Logistics, Bilingual EN/Mandarin)

Salary: RM 9,000 – RM 10,000 per month

About the role

Our logistics platform processes massive volumes of data every day. You'll work on real production systems handling 50TB+ of data, across the Spark, Flink, and Hadoop ecosystems. You'll design systems that never fall over, tune pipelines that run faster, and build the platform that our data analysts and algorithm engineers depend on.

Key responsibilities

• Participate in designing and building highly available, scalable big data architectures — including Lambda and Kappa patterns — and support implementing technical solutions under appropriate guidance

• Optimize large-scale data processing workloads — Spark job tuning, Flink state backend optimization, memory utilization, data processing efficiency, and overall system stability

• Independently develop and maintain core modules of the big data platform, and resolve technical issues across data processing pipelines

• Work closely with data analysts, algorithm engineers, and other technical teams to provide efficient data interfaces, data services, and supporting tools

• Lead or participate in technical solution design, evaluate implementation approaches, and ensure solutions are scalable, stable, and maintainable

• Prepare and maintain technical design documents, development documentation, and implementation records — and support the successful delivery of technical solutions

About you

• Bachelor's degree or above in Computer Science, Software Engineering, Information Technology, or a related discipline

• At least 3 years of hands-on big data development experience, including leading or playing a key role in developing, implementing, or refactoring core modules of large-scale data platforms with 50TB+ data volumes

• Strong knowledge of the Hadoop, Spark, and Flink ecosystems — architecture, development, deployment, and performance optimization

• Solid experience with streaming data architectures and technologies such as Kafka or Pulsar

• Strong programming and data development skills using SQL, Hive, and at least one major language such as Python, Java, or Scala

• Hands-on experience with Doris or StarRocks — configuration, SQL optimization, and performance tuning

• Experience in distributed system performance optimization (e.g., Spark Shuffle optimization, Flink backpressure management, state management, or resource optimization) — highly preferred

• Experience with data lake technologies (Apache Iceberg, Delta Lake, or Apache Paimon), including incremental data processing — an advantage

• Experience with cloud-native or large-scale big data environments (EMR, CDH, or Kubernetes-based resource scheduling and cluster operations) — an advantage

• Effective communication in Mandarin for technical discussions and review of technical documentation — required in this role

What We Offer

• Work on 50TB+ production data platforms — the kind of scale and complexity that grows your career fast

• Get hands-on with a rich tech stack: Spark, Flink, Kafka/Pulsar, Doris/StarRocks, Iceberg/Delta Lake, Kubernetes

• Your Mandarin skills are genuinely used every day in technical discussions and documentation with our regional team

• Be part of a fast-growing e-commerce logistics company with real data challenges to solve

• Clear career path with opportunities to grow into senior engineering, architect, or tech lead roles

• Competitive salary with comprehensive benefits