Research-focused engineer on Reflection's pre-training team: designs and runs experiments on language-model scaling, data efficiency, optimizers, and model architecture; implements deep learning methods, leads small research projects, and optimizes distributed training infrastructure, primarily using Python and PyTorch.
You will research and build solutions for algorithms, scaling laws, data processing, optimizers, and model architecture. You will run experiments on language-model scaling and data efficiency, implement deep learning methods, lead research projects, optimize training infrastructure, and contribute from low-level optimization through high-level model design.
Responsibilities
Research and build solutions across algorithms scaling laws data processing optimizers and model architecture
Design and run experiments on language model scaling and data efficiency
Implement deep learning methods
Lead small research projects
Optimize training infrastructure for efficient scaling
Contribute from low-level optimization through high-level model design