wynd-labs · Remote ·
Senior Backend Engineer building scalable data pipeline infrastructure at Wynd Labs, the team behind Grass, which delivers large-scale public web data to companies training AI models. Day-to-day involves designing distributed real-time and batch pipelines using Golang, Python, Redis, and Kubernetes on a fully remote team overlapping EST hours.
fieldmaterials · San Francisco, United States of America
Trillion Technology Solutions · Reston, VA, US
Grailed · Anywhere in the World
Pendulum Intelligence · Remote (United States)
Who We Are:
We build infrastructure that delivers massive amounts of web data to the companies training the world’s most powerful AI models.
We're the team that helps to power and support Grass, a bandwidth-sharing network that lets us operate a massive distributed crawler, giving us unique access to high-quality public web data at global scale. On top of that, we’ve built pipelines for ingesting, segmenting, and annotating billions of videos, transcripts, and audio files, powering dataset creation for frontier labs.
We’re lean, technical, and move fast. No red tape, no slow decision-making; just a team of builders pushing to expand what’s possible for open web data and AI.
The Role:
We are seeking a Senior Backend Engineer with deep expertise in backend development, particularly in data pipeline infrastructure. In this role, you will join a small, high-performing team to design and architect scalable systems, drive technical excellence, and help advance Grass’s role in shaping the future of the internet.
Please note: This role requires a work schedule that sufficiently overlaps with EST business hours to collaborate effectively with the team.
Who You Are:
7+ years of experience in software development, with a track record of writing high-quality, maintainable, and robust code.
Bachelor’s or Master’s degree in a STEM field, or equivalent practical experience.
Strong experience building and scaling large, distributed systems.
Deep expertise in designing, troubleshooting, and optimizing complex, live software systems.
Hands-on experience with modern development practices, including continuous integration and continuous deployment.
Strong analytical and problem-solving skills, particularly in diagnosing and resolving data flow and system performance issues.
Professional or native English proficiency.
What You'll Be Doing:
Design, build, and optimize scalable data pipeline infrastructure for real-time and batch data processing.
Develop new backend features and system improvements, focusing on reliability and performance.
Write clear, well-tested, and well-documented code.
Create and review technical designs, code, and documentation to maintain high engineering standards.
Contribute to Wynd’s infrastructure across mobile, desktop, and server-side systems.
Technologies Used:
Golang, Python, Redis Clusters, Kubernetes.
Why Work With Us:
Opportunity. We are at the forefront of developing a web-scale crawler and knowledge graph that improves access to public web data and extends the value of AI to the people.
Culture. We're a lean team with a high bar. We come to work not to be comfortable, but to find out what we're capable of and to do work that matters. We're not calling for people who keep things moving. We're calling for people who make everyone around them better.
We prioritize low ego and high output. This is a fully remote team.
Compensation. You’ll receive a competitive salary & benefits.
Xneural GmbH · Dresden, SACHSEN, DEUTSCHLAND