site reliability engineer – data platform

Описание:

IMC is a research-driven trading firm where quantitative modeling, machine learning, and engineering shape how modern markets are traded. It provides liquidity across trading venues and builds proprietary systems and algorithms that operate across global markets.

Задачи:

• Design, implement, and operate data platforms
• Improve observability to identify issues before users do
• Build automation to reduce toil and help systems scale
• Support and own the reliability of critical services such as HDFS, Kafka, and Dremio
• Drive long-term architectural improvements that prevent issues

Требования:

• Strong experience managing distributed data platforms, including installation, debugging, and performance tuning
• Hands-on experience deploying, configuring, and orchestrating software on Linux and Kubernetes, with the ability to troubleshoot issues in both environments
• Strong experience with infrastructure as code and best practices
• Proficient programming experience in Python
• Ability to read, write, and tune SQL queries
• Comfortable reading Java source code and tuning and debugging running JVMs
• A proactive mindset focused on preventing issues
• Comfortable working across teams with minimal oversight
• Будет плюсом: experience with Ansible, familiarity with data lakehouse technologies such as Iceberg or Delta Lake, query engine technologies such as Dremio, Presto, or Trino, and exposure to workflow orchestration tools such as Airflow or Dagster