Senior Data Engineer, Telemetry & Analytics Tooling

We are looking for a Senior Data Engineer to build and extend the framework and tooling that our telemetry and analytics run on: collection, transformation, aggregation, access and visualization. The aim is for product managers, project managers and engineers to answer most of their own analytics and research questions without going through a specialist.
Over the past three years we have standardized how telemetry and product data are collected, made that data available for analysis in UI tools (Kibana, Tableau), and taught our product and project managers to use those tools and analyze data themselves.
You will also take on the analyses that self-service cannot reach: how our services operate, perform and stay stable, and how our features are actually used.
You will be part of
A Telemetry/Data team that works closely with product owners and development teams. You will own the tools and pipelines that collect and expose data across the department, and you will manage two data engineers working on data collection, processing and analytics.
Responsibilities

Design, build and evolve the framework and tooling for collecting, transforming and aggregating telemetry and product data, and adjust it as products and services change
Build self-service capability: data models, aggregations, dashboards and tooling that let non-specialists do their own analysis and research
Process and model OpenTelemetry data (traces, metrics and logs) at scale
Manage two data engineers: set technical direction, review designs and grow the team's capability
Work with frontend and backend development teams to instrument their systems and report telemetry and analytics data consistently
Take on the analyses that go beyond self-service: how services operate, perform and remain stable, and how features are used
Own data access and quality: make the right data available to the right people, in a form they can trust
Enable colleagues through documentation, dashboard patterns and hands-on support
Present findings using clear data visualization

Requirements and skills

5+ years of experience building data platforms, telemetry pipelines or analytics tooling
Strong programming skills in both Java and Python
Deep experience with the ELK Stack (Elasticsearch, Logstash, Kibana): index and mapping design, ingest pipelines, aggregations and Kibana dashboards
Experience with OpenTelemetry across traces, metrics and logs: instrumentation, collectors and the Elastic OpenTelemetry distributions (EDOT)
Experience building data collection systems end to end, from instrumentation through to consumption
Experience leading or managing engineers, and setting technical direction for a small team
Experience partnering with development teams to standardize instrumentation across frontend and backend systems
Strong analytical and math skills (e.g. statistics) applied to performance, stability and usage data
Problem-solving aptitude and business acumen
Excellent communication skills, including the ability to teach non-specialists to use data tooling themselves
BSc/BA in Computer Science, Engineering or a relevant field

Good to have

Experience with AWS analytics services (Amazon EMR, Amazon Athena)
Understanding of machine learning and its application to anomaly and trend detection in telemetry
Knowledge of SQL
Experience with business intelligence tools (e.g. Tableau)
Graduate degree in a quantitative field

Benefits

Competitive salary, annual performance-based bonus, and stock grant awards
401(k) retirement plan with competitive company match
Excellent health and wellness benefits, including medical, dental, and vision benefits. 100% employer-paid medical premiums, with generous employer contributions to dental & vision plans as well.
Wellness screening and assessments, health coaches, and counseling services through an Employee Assistance Program (EAP)
Generous paid parental leave (up to 16 weeks paid parental leave for eligible employees)
Company-paid basic life insurance, accidental death & dismemberment (AD&D), and short- and long-term disability coverage
Flexible Spending Accounts (Healthcare, Dependent Care, and Commuter FSAs)
Quarterly fitness stipend to offset costs associated with traditional gym and fitness memberships or fees
Education reimbursement and professional development opportunities
Legal services, telehealth access, and voluntary insurance options
Backup child and adult care support through Care.com
Daily lunch allowance and fully stocked kitchen with healthy breakfast and snack options