Despite the 'Data Engineer' title, this is a backend engineering role: designing and building .NET Core/C# REST APIs, microservices and AWS event-driven integrations (SNS, SQS, Lambda, EventBridge, API Gateway) at International SOS in Singapore, with CI/CD, testing, documentation and production support.
The Data Engineer will design, develop and support secure, scalable backend applications using .NET Core, C#, the Microsoft technology stack and AWS cloud services. The role focuses on building reliable APIs, microservices and event-driven integrations using AWS services such as SNS, SQS, Lambda, EventBridge, API Gateway and managed data services.
- Analyze business and technical requirements for backend, API, cloud and integration solutions
- Design and develop .NET Core applications, REST APIs, microservices and reusable integration components
- Build AWS-based event-driven solutions using SNS, SQS, Lambda, EventBridge and API Gateway
- Apply asynchronous messaging, queue-based processing, retries, dead-letter queues and idempotency patterns
- Create and maintain technical documentation, API contracts, message schemas and operational support notes
- Collaborate with product, architecture, QA, DevOps/SRE, cloud platform and vendor teams
Responsibilities
- Design, develop, test and maintain backend applications using .NET Core, C#, ASP.NET Core Web APIs, Entity Framework Core and related Microsoft development frameworks.
- Build secure RESTful APIs and integration services with clear contracts, versioning, validation, authentication, authorization and effective error handling.
- Implement event-driven and asynchronous communication patterns using AWS SNS, SQS, Lambda and EventBridge, including publish/subscribe, queue-based processing, retries, dead-letter queues and message tracing.
- Support cloud-native workloads on AWS using services such as API Gateway, Lambda, EKS/ECS, RDS, DynamoDB, S3, Secrets Manager, IAM and CloudWatch.
- Apply microservices, distributed systems, resiliency, observability, logging and monitoring practices to improve system reliability and supportability.
- Troubleshoot and resolve application, API, database, messaging and cloud infrastructure issues across development, test and production environments.
- Create technical specifications, solution notes, sequence diagrams, API contracts, event/message schemas and operational documentation.
- Support CI/CD, automated testing, code reviews, release activities and infrastructure as code using tools such as Git, Bitbucket, Jira, Confluence, Terraform, CloudFormation, Jenkins or GitHub Actions.
- Collaborate with product owners, business analysts, architects, QA, DevOps/SRE, cloud platform teams and third-party vendors to deliver high-quality solutions.
- Contribute to engineering standards, reusable patterns, documentation and continuous improvement across the development team.
Requirements
- Bachelor’s degree in Computer Science, Information Technology (or similar)
- 6-8 years of software development experience across design, development, testing, release and production support.
- Strong hands-on experience with .NET Core / .NET 6+, C#, ASP.NET Core, Web APIs, Entity Framework Core, LINQ, asynchronous programming and secure coding practices.
- Experience with the broader .NET and Microsoft stack, including Visual Studio, NuGet, dependency injection, configuration management, authentication/authorization, unit testing and diagnostics.
- Hands-on AWS development experience with SNS, SQS, Lambda, EventBridge, API Gateway, EKS/ECS, RDS, DynamoDB, S3, Secrets Manager, IAM and CloudWatch.
- Practical knowledge of event-driven architecture, including publish/subscribe, queue-based processing, fan-out, dead-letter queues, retry policies, idempotency, correlation IDs and eventual consistency.
- Experience with microservices, REST APIs, OpenAPI/Swagger, JSON, XML, API-led integration and service-to-service communication.
- Working knowledge of SQL Server, PostgreSQL and NoSQL databases such as MongoDB or DynamoDB.
- Experience with Docker, Kubernetes/EKS, CI/CD, Git-based development, automated builds, deployment pipelines and infrastructure as code using Terraform or CloudFormation.
- Familiarity with engineering and testing tools such as Postman, JMeter, Swagger/OpenAPI, Jira, Confluence, Bitbucket and monitoring/logging platforms.
- Good understanding of unit testing, integration testing, contract testing, performance testing and test automation practices.
- Understanding of application security, secrets management, encryption, least-privilege access, OWASP principles and secure API design.
- Strong troubleshooting and analytical skills across application code, APIs, databases, queues, cloud services and deployment pipelines.
- Good communication, collaboration and documentation skills with the ability to explain technical concepts clearly.
- Ability to work effectively in Agile delivery teams and coordinate across product, architecture, engineering, QA, DevOps/SRE and vendor stakeholders.
- Organized, detail-oriented and able to manage multiple priorities in a dynamic environment.