AI Data Operations Specialist | Up to $5500 | Fintech MNC at RecruitFirst – Raffles Place | Jobyssey

Salary: $5,500 per month

Location: Raffles Place

Salary: Up to $5500

Duration: 1 year contract, subject to extension/conversion

Working Hours: 5 days a week, 9am-6pm

Responsibilities

Support model evaluation, training, and user growth projects by implementing project workflows and annotation guidelines to meet agreed objectives, timelines, and quality standards.
Collaborate with product managers, project owners, researchers, and external partners.
Communicate progress, bottlenecks, and risks promptly, and propose corrective actions as needed.
Conduct systematic quality audits of annotations delivered by external partners to ensure accuracy, content quality, and alignment with project requirements and training objectives.
Maintain clear audit records, identify recurring errors and quality risks, and provide actionable feedback to improve annotation quality and consistency.
Help develop and maintain annotation guidelines, technical documentation, and example libraries across domains such as reasoning, general knowledge, STEM, and humanities.
Support exploratory AI projects through hands-on annotation and workflow testing, helping translate emerging requirements into consistent, scalable processes.
Develop and maintain code-based tools and AI workflows for process automation, data analysis, format conversion, and model capability enhancement.
Design, test, and refine prompts, reusable AI skills, and agent workflows, and support their debugging, evaluation, deployment, and ongoing improvement across relevant platforms.
Use Python, SQL, statistical analysis, and data visualization to analyze annotation quality, model performance, and dataset coverage.
Identify error trends and performance gaps, monitor data pipeline health, and collaborate with model trainers and researchers to generate actionable insights that inform guideline updates, training strategies, and improvements to training data.
Stay informed about advances in large language models, AI agents, and model evaluation methods.
Research emerging technologies, competitor approaches, and industry practices to identify and help implement practical improvements to tools, workflows, and data quality.

Requirements

Bachelor's degree or higher, preferably in Computer Science, Data Science, Statistics, or a related field.
Professional working proficiency in English, spoken and written, with the ability to collaborate across teams, understand and write project guidelines, and perform bilingual data and annotation tasks.
Hands-on experience designing, testing, and refining prompts for large language models, with the ability to evaluate model outputs against task requirements and improve prompts based on identified issues.
Proficiency in Python for data processing, analysis, and workflow automation, including familiarity with pandas, NumPy, and common data visualization libraries; ability to use SQL to query and analyze data.
Strong analytical skills and attention to detail, with the ability to systematically identify data quality issues, recurring errors, and anomalies, and propose clear, actionable improvements.
A strong interest in AI, large language models, and their practical applications, with a willingness to learn new technologies and apply them to improve tools and workflows.

Interested applicants, click the 'Apply' button.

We regret to inform you only shortlisted candidates will be notified.

Choo Ming-Xuan, Debra | R25158765

RecruitFirst Pte Ltd | E.A. 13C6342

Explore more jobs