Entry-level data engineer role maintaining Xiaomi's mobile/app data warehouses in Singapore: building ETL/ELT pipelines, monitoring data quality, and writing SQL and Python/Shell scripts for business analysis. Core stack includes Hadoop, Spark, Flink, Doris, and Iceberg.
Be responsible for the operation and maintenance of data warehouse (mobile device data warehouse, app data warehouse), ensuring data availability and reliability.
Have an good understanding of Xiaomi's internet business, clearly abstract and model business processes, implement the big data processing architecture system suitable for Xiaomi's complex business scenarios, and continue to iterate.
Develop and maintain ETL/ELT pipelines to ingest, transform, and load data from diverse sources into the data warehouse in a timely and accurate manner.
Monitor data pipeline health, troubleshoot data quality issues, and implement alerting mechanisms to proactively detect anomalies.
Write well-structured, efficient SQL and scripts (Python/Shell) to support data processing, reporting, and ad-hoc analysis requests from business teams.
Collaborate with data scientists, analysts, and product managers to understand data requirements and translate them into scalable data solutions.
Document data models, pipeline logic, and data dictionaries to maintain a healthy and accessible data knowledge base.
Requirements:
Bachelor's degree in computer science, software engineering or other related fields.
Have a basic understanding of big data technology architecture (Hadoop, spark, Flink, Doris, iceberg).
Proficient in at least one programming language(Python, Java, etc.), with good knowledge of data structure, algorithms, operating system, etc.