DevOps Engineer – Kafka Specialist
Madiff · Warsaw, Poland ·
- Work mode
- Hybrid
- Category
- Devops
- Company size
- 51-200
At Madiff, we connect top IT talent with cutting-edge companies through remote Agile teams and nearshore outsourcing. With operations in Poland, Portugal, France, and the UK, we specialize in AI, DevOps, and Cybersecurity – supporting industries like Telecom, Banking, and Hi-Tech.
We are looking for a Kafka Infrastructure Engineer to join a high-performing team focused on building and maintaining robust streaming infrastructure. You’ll be working on complex enterprise environments, ensuring the reliability and performance of Kafka-based platforms that support key business applications and services.
Responsibilities:
- Manage and maintain high-availability Kafka clusters in production
- Monitor Kafka using tools like Burrow, identify lags and performance bottlenecks
- Handle topic configurations, partitioning, replication, and Zookeeper coordination
- Deploy and configure Kafka environments using Ansible
- Work with developers to support application releases and environment expansions
- Liaise with Cloudera support on Kafka-specific issues
- Maintain and support MirrorMaker/SRM for cross-cluster replication
- Support DR processes and participate in on-call rotations
- Log parsing and integration (e.g. Logstash)
- Collaborate with cross-functional teams to optimise performance and stability
Requirements
- Strong experience operating Kafka clusters in a production environment
- Knowledge of Kafka internals: topics, partitions, replication, Zookeeper
- Hands-on experience with Ansible for configuration management
- Exposure to Cloudera Kafka distribution (nice to have)
- Knowledge of SQL
- Experience with MirrorMaker/SRM
- Familiarity with log processing tools and Kafka monitoring
- Readiness to work on-call and support critical environments
- Good communication skills and ability to collaborate across teams
Benefits
- Hybrid work model – 1 day per week in the client's office in Warsaw
- Comprehensive medical care
- Solid, competitive salary.
- Work in multilingual, multinational and multicultural environment on international projects