Data Engineer L3
Sidglobal · Pasig, Philippines ·
- Category
- Data engineering
analyticsautomationazuredata-engineeringdata-warehousingdatabricksproof-of-conceptpysparkpythonsqlunit-testing
Builds and optimizes data pipelines, warehouses, and ETL processes using Python, PySpark, SQL, and Databricks on Azure.
Pasig Ortigas CTR-PO Box# 1100, Philippines
Must-Have Skills & Experience
- Designs and builds data storage solutions including database objects and data structures, dataingestion pipelines
- Develops data transformation, cleansing, and preparation processes.
- Perform job optimization/automation via code enhancement, configuration, or implementationofnew tools/technology
- Perform unit testing and system integration testing.
- Maintain and monitor platform stability and performance of EDP. Execute updates, patches, andother activities required to maintain and enhance operations.
- Ensures compliance with governance standards of the platform, security policies, and SDLCprocesses.
- Collaborate with cross-functional teams to identify data needs and opportunities for improvement
- Develop and maintain documentation related to data engineering and analytics processes andprocedures
- Perform Proof of Concept on new integration and analytic patterns and solutions
- Contribute to best practices and standards for the data engineering team
- Experience on Data projects is a MUST (at least 1 end to end project)
- Experience in using Databricks and Azure (certifications preferred)
- Experience in SQL, Python (Pyspark)
- Knowledge in Data Warehouse and Data Mart concepts and query optimization techniques
- Preferably local resource that can report to BDO office