Human Data Engineer

You will translate model and engineering needs into data and evaluation projects. You will build measurement systems, conduct evaluations, validate data accuracy, improve annotation workflows and tools, research multimodal data methods, and coordinate stakeholders to scale high-quality training data.

Responsibilities

• Translate model and engineering needs into data projects and evaluation strategies
• Deliver critical data and evaluation projects end to end
• Build tools and systems to measure data effectiveness and run evaluations
• Validate factual accuracy and maintain data integrity and truthfulness
• Research, implement, and evaluate data collection, annotation, generation, and multimodal integration techniques
• Shape model behavior and domain performance through targeted data work
• Design and improve annotation workflows, labeling interfaces, and related tools
• Coordinate engineering, technical staff, and Human Data stakeholders
• Scale projects, contribute to demand forecasting, and report status, insights, and blockers

Requirements

• Bachelor’s degree in engineering, computer science, or a related STEM discipline, or 4+ years of experience in lieu of a degree
• Experience collaborating with cross-functional engineering, research, product, or annotation and operations groups
• Experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems
• Weekend work may be required
• Travel to other locations may be required

Benefits

• Equity
• Medical coverage
• Vision coverage
• Dental coverage
• 401(k) retirement plan
• Short-term disability insurance
• Long-term disability insurance
• Life insurance
• Discounts and perks