Company: 1011 United Overseas Bank Ltd
About UOB
United Overseas Bank Limited (UOB) is a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America. In Asia, we operate through our head office in Singapore and banking subsidiaries in China, Indonesia, Malaysia and Thailand, as well as branches and offices. Our history spans more than 80 years. Over this time, we have been guided by our values – Honorable, Enterprising, United and Committed. This means we always strive to do what is right, build for the future, work as one team and pursue long-term success. It is how we work, consistently, be it towards the company, our colleagues or our customers.
Job Description
The team is responsible for driving operational excellence and governance in the adoption of agentic applications across the bank. This role ensures the successful implementation and maintenance of agent-based solutions by defining roadmaps, managing evaluation processes, and embedding responsible AI practices. The position partners with cross-functional teams to deliver secure, efficient, and compliant agentic operations.
Key Responsibilities
Service Operations
- Grow the agent impact through improvement in performance, growth in capabilities and design, build, and roll out for additional users.
- Run the operational processes for agent lifecycle management, including onboarding, configuration, and retirement of agents.
- Monitor agent performance, uptime, and compliance with SLAs.
- Coordinate with business, technology, and innovation teams to integrate agent workflows into incidents, problems, and change management processes.
- Ensure robust logging, audit trails, and reporting agent actions to support transparency and regulatory requirements.
- Drive continuous improvement of service operations through root cause analysis, automation opportunities, and performance optimization.
- Develop and maintain SOPs, FAQs, and user guides to support agentic workflows and ensure clarity for end-users.
Agent Evaluation & Issue Triage
- Apply evaluation frameworks for agent performance, reliability, and compliance.
- Lead issue of triage and resolution processes for agent-related incidents.
- Collaborate with business, technology, and innovation teams to implement corrective actions and improvements.
Prompt Fine-Tuning
- Craft and optimize prompts, system messages, and few-shot examples to maximize model relevance, accuracy, and cost efficiency.
- Monitor performance metrics (e.g., latency, token usage, output quality) and refine prompts or pipelines as needed.
- Ensure prompt tuning aligns with business objectives and ethical guidelines.
- Constantly monitor and evaluate impacts from regulatory, policy or business-directed changes and update roadmap / prompts accordingly.
Key Skills Required
Core Functional Skills
- Performance Monitoring
- Process Improvement
- Service Lifecycle Management
Technical Skills
- Strong Data Science fundamentals: Experimental design, measurement, error analysis, statistical thinking, evaluation methodology. Hands-on Python experience for prototyping and production-grade experimentation.
- Experience with LLM & Agentic AI systems: Fine-tuning, RAG, prompt optimization, evaluation frameworks
- Applied NLP skills: embeddings, retrieval methods, classification/extraction, calibration, and reliability concepts.
- Responsible AI: bias testing, privacy leakage checks, audit artifacts
Qualifications & Experience
- Bachelor’s degree in Data Science, Statistics, Computer Science, Information Systems, or related field
- 15+ years of hands‑on experience designing, building, and operationalizing end‑to‑end AI/ML systems, including data preparation, model development, deployment, and post‑production monitoring.
- A minimum of 1-2 years of dedicated experience working on generative AI and large language model projects.
- Hands-on experience designing prompts, tuning outputs, and integrating large language models (Claude Sonnet 3.5, GPT-class, etc.) into end-user applications.
- Familiarity with AI Agent model evaluation techniques.
- Ability to articulate complex technical concepts to non-technical stakeholders.
- Experience in the banking or financial services industry is a plus.
Additional Requirements
Be a Part of the UOB Family
UOB is an equal opportunity employer. UOB does not discriminate on the basis of a candidate's age, race, gender, color, religion, sexual orientation, physical or mental disability, or other non-merit factors. All employment decisions at UOB are based on business needs, job requirements and qualifications. If you require any assistance or accommodations to be made for the recruitment process, please inform us when you submit your online application.
Apply now and make a Difference