IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder.
This is a fully remote position, open to candidates based in Hong Kong.
Pay: $50–$70/hr
Role Title: Software Engineer
Role Type: Contractor
Location: Remote
We are engaging Software Engineers to contribute their technical expertise to a customer-centric project focused on enhancing development workflows and process automation. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Execute structured evaluation assignments that simulate authentic developer activities, including version control, code review, issue tracking, and CI/CD workflow execution utilizing AI-powered tools.
- Assess and grade the technical correctness of outputs, verifying results hands‑on within relevant development environments and tools.
- Design, seed, and maintain reproducible test environments—such as code repositories with real commit histories and CI workflows—to ensure reliable and realistic task contexts.
- Configure, document, and troubleshoot integrations and authentication flows across multiple software services, ensuring seamless connectivity.
- Investigate and document undocumented product behaviors through hands‑on exploration and systematic testing.
- Participate in calibration sessions to ensure consistent evaluation methods and grading across the contributor group.
Preferred Qualifications
- Minimum of 3 years of professional experience in software engineering, demonstrating strong command of Git/GitHub workflows (pull requests, code review, branching, analyzing diffs, CI log diagnostics).
- Proficient with CI/CD systems—ideally GitHub Actions—including authoring custom workflows and ensuring reproducible build processes.
- Versed in using connectors across Claude and ChatGPT.
- Advanced scripting abilities in Python or Bash, with comfort in automating environment setup and reset tasks; solid understanding of REST APIs, OAuth, and webhook integrations.
- Fluency with major enterprise SaaS platforms such as Slack, Google Workspace, or Microsoft 365; administrative experience in cloud workspaces is advantageous.
- Experience leveraging AI assistants or agent tools in everyday developer tasks; any familiarity with agent tool‑calling or the Model Context Protocol (MCP) is a plus.
- Background in technical QA, evaluation, or data annotation—demonstrating consistency in applying rubrics and identifying nuanced edge cases.
- Exceptional attention to detail, disciplined adherence to defined processes, and outstanding written and verbal communication in English.