Location
singapore, singapore, Singapore
Posted
July 26, 2026
Job Description
Responsibilities
- Develop and maintain AI evaluation frameworks, regression test suites and automated evaluation pipelines.
- Build datasets, quality dashboards and evaluation tools to improve the performance of AI agents and LLM-powered applications.
- Design evaluation methods such as LLM-as-a-Judge, multi-turn conversations, tool evaluation and agent workflow analysis.
- Integrate AI evaluation into CI/CD and model release processes.
- Analyse production issues and improve datasets, prompts, evaluation logic and AI workflows.
- Conduct experiments to optimise model accuracy, retrieval performance, latency and cost.
- Build reusable platform capabilities and developer tools to support multiple AI products.
- Prepare technical documentation and collaborate with cross-functional engineering teams.
- Bachelor's Degree in Computer Science, Software Engineering or a related dis...