Software Development Engineer II, Amazon S3 Metadata
Amazon · Vancouver, British Columbia, CAN ·
- Employment
- Full time
- Category
- Software engineering
- Company size
- 1000+
Software development engineer (SDE II) on Amazon's S3 Metadata team in Vancouver, building fully managed metadata storage and SQL-queryable infrastructure that indexes trillions of S3 objects. Day to day: designing and deploying distributed systems (Apache Iceberg), code reviews, cross-team collaboration, and owning production operations.
Are you passionate about building critical infrastructure that enables the future of AI? Amazon S3 Metadata is transforming how enterprises leverage their data at infinite scale. We're using latest technologies like Apache Iceberg to create metadata storage solutions that make trillions of objects instantly queryable, empowering customers to unlock AI capabilities on their existing data lakes without complex synchronization workflows.
Join us if you're energized by solving complex system software challenges that deliver tangible customer impact. You'll work on technologies that don't just use AI—they enable it. This is an opportunity to build software solutions that address real-world problems at S3 scale, where your code directly influences how customers discover, organize, and derive value from massive datasets.
Key job responsibilities
- Design, develop, test, and deploy scalable software components for S3 Metadata infrastructure, ensuring operational excellence throughout the full software development lifecycle
- Build distributed systems leveraging modern technologies like Apache Iceberg to handle infinite-scale metadata storage and query processing
- Participate actively in code reviews, providing constructive feedback to teammates and continuously improving code quality and engineering practices
- Collaborate with customers, stakeholders, and cross-functional teams to understand business requirements and deliver solutions that balance feature development with operational needs
- Own operational support for your services, investigating root causes of issues and implementing permanent solutions that enhance system reliability and customer experience
A day in the life
You'll design elegant solutions to complex metadata storage challenges, write high-quality code, and see your features come to life as you deploy and operate services in production. Your day involves collaborating with engineers across Amazon to integrate innovative technologies, testing at scale, and monitoring real customer usage. You'll witness firsthand how your software solves critical problems—enabling enterprises to query trillions of objects efficiently and unlock AI-driven insights from their data lakes.
About the team
Amazon S3 Metadata is building a fully managed feature that automatically surfaces, stores, and organizes metadata for objects in S3 general-purpose buckets, making it instantly queryable via standard SQL. Our team tackles the operational challenge of tracking and indexing trillions of objects across sprawling data lakes, eliminating the need for complex synchronization workflows or external databases. We're focused on delivering infrastructure that empowers customers to leverage AI on their existing data seamlessly. Our collaborative culture encourages knowledge-sharing, mentorship, and continuous learning as we push the boundaries of storage technology at unprecedented scale.
Join us if you're energized by solving complex system software challenges that deliver tangible customer impact. You'll work on technologies that don't just use AI—they enable it. This is an opportunity to build software solutions that address real-world problems at S3 scale, where your code directly influences how customers discover, organize, and derive value from massive datasets.
Key job responsibilities
- Design, develop, test, and deploy scalable software components for S3 Metadata infrastructure, ensuring operational excellence throughout the full software development lifecycle
- Build distributed systems leveraging modern technologies like Apache Iceberg to handle infinite-scale metadata storage and query processing
- Participate actively in code reviews, providing constructive feedback to teammates and continuously improving code quality and engineering practices
- Collaborate with customers, stakeholders, and cross-functional teams to understand business requirements and deliver solutions that balance feature development with operational needs
- Own operational support for your services, investigating root causes of issues and implementing permanent solutions that enhance system reliability and customer experience
A day in the life
You'll design elegant solutions to complex metadata storage challenges, write high-quality code, and see your features come to life as you deploy and operate services in production. Your day involves collaborating with engineers across Amazon to integrate innovative technologies, testing at scale, and monitoring real customer usage. You'll witness firsthand how your software solves critical problems—enabling enterprises to query trillions of objects efficiently and unlock AI-driven insights from their data lakes.
About the team
Amazon S3 Metadata is building a fully managed feature that automatically surfaces, stores, and organizes metadata for objects in S3 general-purpose buckets, making it instantly queryable via standard SQL. Our team tackles the operational challenge of tracking and indexing trillions of objects across sprawling data lakes, eliminating the need for complex synchronization workflows or external databases. We're focused on delivering infrastructure that empowers customers to leverage AI on their existing data seamlessly. Our collaborative culture encourages knowledge-sharing, mentorship, and continuous learning as we push the boundaries of storage technology at unprecedented scale.