Data Integration Engineer

Data Integration Engineer at N Consulting Ltd

Job Description:

We are seeking a highly skilled Senior Integration Engineer to join our banking client’s Data Integration and APIs team. The ideal candidate will have extensive experience in application integration, particularly within the banking sector. You will play a key role in designing, developing, and maintaining robust integration solutions, enabling seamless data flow across diverse platforms and applications.

You will also make pragmatic use of AI-based tools (including vibe coding / natural-language driven development) to increase efficiency and quality across the integration lifecycle.

Key Responsibilities:

• Design, develop, and support integration solutions using Python, Java, and SQL Server.
• Implement and manage real-time data streaming solutions using Kafka.
• Manage and optimize APIs through API Management Platforms, ideally Gravitee.
• Deploy, monitor, and maintain integration components within Openshift environments.
• Collaborate with cross-functional teams to gather requirements and deliver scalable integration solutions.
• Ensure integration solutions comply with security, regulatory, and performance standards.
• Troubleshoot and resolve complex integration issues, providing expert guidance to junior team members.
• Maintain documentation for integration processes, workflows, and standards.
• Use AI tools in a targeted way (including vibe coding approaches) to:
  • Accelerate development, testing, and documentation.
  • Support analysis of logs, incidents, and performance data.
• Stay updated with the latest trends and technologies in application integration and data management.

Required Skills & Experience:

• Minimum 5 years’ hands‑on experience in application integration, preferably within the banking or financial services sector.
• Strong proficiency in Python and Java for integration development.
• Advanced knowledge of SQL Server for data handling and transformation.
• Experience developing APIs with FastAPI.
• Practical experience with Kafka for data streaming and messaging.
• Hands‑on experience with API Management Platforms (Gravitee preferred).
• Solid understanding of containerization and orchestration using Openshift.
• Usage of AI for coding tasks and automation, including:
  • Experience using AI assistants to support coding, testing, and documentation.
  • Familiarity with vibe coding / natural‑language driven solutioning, with the ability to critically review AI outputs.
• Proven expertise in Event Driven Architecture and Microservices Architecture.
• Practical knowledge of Enterprise Integration Patterns.
• Experience with ETL/ELT processes for data integration and transformation.
• Practical experience with Model Context Protocol (MCP), including its implementation for efficient data exchange, model management, and integration within complex system architectures.
• Experience in designing, implementing, and supporting mission critical services.
• Proven ability to design and implement secure, scalable integration solutions.
• Excellent problem‑solving and communication skills.
• Knowledge of Talend ESB and Apache Camel.
• Familiarity with other API management platforms and integration tools.

Education :

• Bachelor’s or Master’s Degree in Computer Science, Information Systems, or related field.

Sr. No. Skillset Years of Experience.

1 Strong proficiency in Python and Hadoop (Primary) and Java (Secondary) for integration development. Must include exp. In CV.

2 Strong experience of SQL Server for data handling and transformation. Must include exp. In CV.

3 5+ years of strong experience with Kafka for data streaming and messaging. Must include exp. In CV.

4 Solid understanding on containerization and orchestration using Openshift. Must include exp. In CV.

5 Experience with ETL/ELT processes for data integration and transformation. Must include exp. In CV.

6 Manage and optimize APIs through API Management Platforms Must include exp. In CV.

7 Usage of AI for coding tasks and automation Must include exp. In CV.

8 Proven expertise in Event Driven Architecture and Microservices Architecture. Must include exp. In CV.