Data Engineer
VIDA · Karnataka, Bengaluru, India ·
- Category
- Data engineering
- Experience
- 5+ years
VIDA · Karnataka, Bengaluru, India ·
Build and expose the data lake/lakehouse so teams can understand business and product performance and make better decisions.
Design and evolve a data platform that enables scientists and analysts to query, model, and ship features and product metrics.
Develop scalable and reliable batch and streaming pipelines that ingest from varied sources and land trusted datasets.
Maintain and fix existing ETLs, improving reliability, observability, and cost while planning safe backfills and replays.
Model curated layers and maintain transformation logic (e.g., dbt), including testing, documentation, and data quality.
Build with Infrastructure as Code (e.g., Terraform) and contribute to CI/CD and deployment practices.
Partner with Engineering, and Data Science to deliver low-latency signals and features for real-time decisioning.
Contribute to internal tools, reusable components, and simple dashboards that unblock self-service.
Solid engineering foundation with 5+ years of relevant experience in data engineering and/or distributed systems.
Hands-on work building data pipelines (batch and/or streaming) using at least one distributed framework (e.g., Spark, Kafka, Flink).
Comfortable with SQL and a transformation framework (e.g., dbt or similar).
Familiarity with AWS services for data (any mix of S3, EMR/Glue, Kinesis/MSK, Lambda, Redshift/Athena) or equivalent cloud experience.
Exposure to workflow orchestration (e.g., Airflow).
Experience using Terraform (or similar IaC) to manage data/platform resources.
Ownership mindset, focus on reliability, and enjoyment of collaborating in a fast-moving environment.
Billions of people still cannot securely prove their identity. Without it, they’re shut out of education, healthcare, finance, and civic participation. We believe this must change—and that digital identity should be trustworthy, private, and accessible to everyone.
At VIDA, we’re creating a frictionless digital identity system that meets the needs of our time and works anywhere, for everyone.
Global initiatives like the UN and World Bank’s ID4D aim to provide legal identity for all by 2030. We expect digital identity to become a basic right, and we want VIDA to help lead that future.
We’re a mission-driven, pragmatic team motivated by real-world impact—from preventing fraud and corruption to unlocking fair access to essential services. If that resonates with you, we’d love to talk.