We are looking for Senior Data Engineer with 10 years of experience.
Data Ingestion Design & Development
- Design, develop, and maintain Qlik Replicate data pipelines for near-real-time and batch data replication between heterogeneous systems (e.g., Oracle, Cloudera, DB2, etc.).
- Administer Qlik Replicate servers, monitor task performance, and manage licensing, upgrades, and patches.
- Implement best practices for replication task configuration, error handling, and resource optimization.
- Troubleshoot data replication issues, performance bottlenecks, and connectivity errors across environments.
- Oracle DB knowledge and proficient in writing complex SQL queries and PL/SQL programs
- Unix basic knowledge and hands-on Unix scripting
- Hadoop (Cloudera Data Platform) basic knowledge and hands-on
Data Integration & Project Delivery
- Collaborate with business and technical teams to understand data integration requirements and deliver end-to-end data migration/replication solutions.
- Participate in data modernization, cloud migration, or analytics platform initiatives.
- Develop technical documentation, architecture diagrams, and operational guides.
- Support testing, validation, and deployment of data pipelines into production.
- Post development, actively plan and implement automation for the Qlik tasks and associated programs before handing over to BAU
- Knowledge in CI/CD is a plus
The Job
Data Ingestion Design & Development
- Design, develop, and maintain Qlik Replicate data pipelines for near-real-time and batch data replication between heterogeneous systems (e.g., Oracle, Cloudera, DB2, etc.).
- Administer Qlik Replicate servers, monitor task performance, and manage licensing, upgrades, and patches.
- Implement best practices for replication task configuration, error handling, and resource optimization.
- Troubleshoot data replication issues, performance bottlenecks, and connectivity errors across environments.
- Oracle DB knowledge and proficient in writing complex SQL queries and PL/SQL programs
- Unix basic knowledge and hands-on Unix scripting
- Hadoop (Cloudera Data Platform) basic knowledge and hands-on
Data Integration & Project Delivery
- Collaborate with business and technical teams to understand data integration requirements and deliver end-to-end data migration/replication solutions.
- Participate in data modernization, cloud migration, or analytics platform initiatives.
- Develop technical documentation, architecture diagrams, and operational guides.
- Support testing, validation, and deployment of data pipelines into production.
- Post development, actively plan and implement automation for the Qlik tasks and associated programs before handing over to BAU
- Knowledge in CI/CD is a plus
BAU Support & Maintenance
- Provide Level 2/3 support for production Qlik Replicate environments, ensuring minimal downtime.
- Monitor replication tasks, alerts, and logs; perform root cause analysis for incidents.
- Coordinate with DBAs, infrastructure, and application teams to resolve issues promptly.
- Ensure compliance with data governance, audit, and security standards.
- Collaboration & Stakeholder Engagement
- Work with business users, data architects, and data analysts to ensure consistent and reliable data delivery.
- Participate in team meetings, and cross-functional discussions.
- Train or guide junior developers or support staff when required.
- Takes accountability in considering business and regulatory compliance risks and takes appropriate steps to mitigate the risks.
- Maintains awareness of industry trends on regulatory compliance, emerging threats and technologies in order to understand the risk and better safeguard the company.
- Highlights any potential concerns /risks and proactively shares best risk management practices.
Mandatory skillsets:
- Over 10 years of experience in software engineering, with a strong focus on the Data and AI domain, including hands-on expertise in data engineering
- 5+ years of hands-on experience in Qlik Replicate (Attunity Replicate) as both Developer and Administrator.
- Strong understanding of relational databases, replication concepts (CDC, full load, incremental load), and data warehousing.
- Experience with Qlik Enterprise Manager, Qlik Compose and other related Qlik tools
- Proficiency in PL/SQL, SQL, database troubleshooting, and performance tuning.
- Familiarity with Linux/Windows scripting, network configuration, and security setup for Qlik Replicate environments.
- Hands-on experience in Big Data Hadoop systems is an added advantage
- Working experience in Talend ETL tool is a plus
- Strong analytical and problem-solving skills, with attention to detail.
- Excellent communication and stakeholder management abilities across remote teams.
- High level of integrity, takes accountability of work and good attitude over teamwork.
- Takes initiative to improve current state of things and adaptable to embrace new changes.