SproutsAI is hiring a Ruby-focused developer to build and support data processing algorithms and pipelines in a petabyte-scale distributed system, including blockchain/crypto data parsers, CI/CD, and monitoring. Core stack is Ruby, SQL, and Linux, with Rails, GraphQL, Airflow, and ClickHouse as welcome extras.
We are looking for a professional developer to support existing and implement new algorithms of data processing in the massive data processing system. Your role will concern building an effective data pipeline, analyzing the data, and building algorithms to parse data and extract information.
Key Responsibilities
Implement data processing algorithms (primarily on Ruby)
Configure, debug, and support software running on large hardware cluster
Blockchain/crypto data parser programming, including the implementation of new protocols
Adopting CI/CD, monitoring and alerting system
Take part in data quality control, monitoring, and data quality assurance
Operate on a large distributed cluster of data processing and storage (Petabytes +)
Requirements
Experience in Ruby language
Good understanding of database technologies, data structures, algorithms
Familiar with server programming, Linux
Use to work with data
Desire to understand a variety of systems and projects