Data Engineer (UK IT SAAS, Hybrid)

Schedule: Monday to Friday (11:00AM - 8:00PM PHT)

What are we looking for?

Skills Required:

• Proven experience in data engineering, including the design, development, and support of scalable data pipelines.
• Strong understanding of modern data storage formats, such as Parquet, with exposure to Delta Lake and Delta Tables.
• Hands-on experience with Apache Spark, including the use of DataFrame APIs for data processing and transformation.
• Familiarity with Databricks, including notebook development, workflow orchestration, and scheduled job management.
• Knowledge of data governance and cataloguing solutions, such as Unity Catalog or equivalent platforms, is advantageous.
• Proficient in Python, with the ability to develop clean, maintainable code, navigate existing codebases, and contribute effectively to ongoing development initiatives.
• Practical experience with Microsoft Azure data services, including Azure Data Factory, Azure Data Lake Storage, Synapse Analytics, or similar cloud-based solutions.
• Solid understanding of cloud computing fundamentals, including scalability, cost optimisation, security, and operational best practices.
• Experience using Azure DevOps to support software delivery processes, including build and release pipelines, deployment approvals, and release monitoring.

Nice to Have:

• Strong knowledge of CI/CD practices, including automated testing, code quality validation, environment promotion, release governance, deployment automation, and rollback strategies.
• Experience working in Agile environments, leveraging Git-based version control, pull requests, code reviews, and established branching and deployment standards.
• Desirable experience with C#/.NET, DuckDB, AWS services, streaming technologies such as Apache Kafka or Azure Event Hubs, and data transformation or data quality frameworks.

What will you do?

• Build and maintain data pipelines using Apache Spark and Databricks, following agreed designs and team standards.
• Work with structured and semi-structured data in Parquet and Delta Table formats.
• Support the management of data assets within Unity Catalogue, including basic governance, organisation, and access control.
• Collaborate with architects and senior engineers to implement data models, ingestion patterns, and transformation logic.
• Write clear, maintainable Python code and contribute to testing and code reviews.
• Investigate and help resolve data quality, pipeline, and performance issues, with support from the wider team.
• Take an active role in Azure DevOps delivery practices, including Git-based branching, pull requests, build and release pipelines, CI/CD deployment processes, and clear tracking of work through boards and delivery artefacts.
• Support the wider engineering team as required, and remain open to learning across different parts of the platform.

Join the awesome team and enjoy these benefits & perks

• Medical, Dental Coverage and Life insurance from day 1 of employment
• Paid Vacation and Sick Leave (with Quarterly Sick Leave Conversion)
• Competitive salary package and annual appraisal
• Financial Assistance Program
• Mandatory Government Benefits and 13th Month Pay
• Complimentary Sleeping Quarters, Coffee at no cost
• Complimentary Office Fitness and Wellness Facilities at no cost
• Regular Company Events, Work Life Balance, and Career growth opportunities
• Accessible location at the heart of Metro Manila --- the Mega Tower, EDSA

ConnectOS is certified as a Great Place to Work and is a top-rated Philippines employer of choice.

#ConnectOSCareers #JoinConnectOS #ConnectOSTech

Equal Employment Statement

Employment decisions at ConnectOS will be conducted without consideration of factors such as age', race, color, religion, gender, disability status, sexual orientation, gender identity or expression, genetic information, and marital status. ConnectOS ensures the full confidentiality of the data it processes.