Clera
Research Engineer, Benchmarks
- Location
- Singapore, SG
- Arrangement
- On-site
- Employment type
- Full-time
- Posted
- 11 November 2026 (4 days ago)
Checked 3 days agoApplications go to the employer, never to RoleSprint
About this role
ABOUT THE ROLE
Join a small, technical AI evaluation team building rigorous benchmarks for frontier AI agents. You will own the design and implementation of domain-specific evaluations that help research teams and customers understand how agents perform on realistic workflows.
WHAT YOU'LL DO
- Design, implement, and maintain internal benchmarks for evaluating frontier agents on domain-specific tasks.
- Partner with subject-matter experts to translate real-world workflows into benchmark tasks and evaluation criteria.
- Build reliable infrastructure to run models and agents against benchmark tasks at scale.
- Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
- Validate whether benchmark results align with real-world evaluations and user needs.
- Write clear technical documentation and reports explaining benchmark methods and results.
WHAT WE'RE LOOKING FOR
- Two to four years of experience in software engineering, machine learning engineering, or research engineering, including at least two years building AI benchmarks, evaluation infrastructure, or agent environments.
- Technical education or strong fundamentals in a technical field.
- Proficiency with Python, Docker, and Linux for research or production infrastructure.
- Hands-on experience designing and operating evaluations or environments for AI agents or large language models.
- Experience building reliable model or agent execution infrastructure, developing evaluation metrics or statistical analyses, and validating benchmark performance.
- Ability to work with subject-matter experts and understand workflows across technical or business domains.
- Strong technical writing, attention to detail, independent problem-solving, and comfort in an early-stage environment.
- Published research or technical writing on AI benchmarks, evaluation methods, or model failure modes is valued. Reinforcement learning pipelines, data generation, and agent evaluation experience are also relevant.
COMPENSATION & BENEFITS
Base salary: $100,000 to $170,000 USD annually. Visa sponsorship is available.
LOCATION
On-site in Singapore, Singapore.
Work location
- Singapore, SG
Related jobs
Ready to make a decision?
This role is either worth your time or it isn’t.
Analyze the posting against your experience, see the gaps clearly, and build the right materials only if the opportunity makes sense.
Nothing is submitted automatically. You choose what happens next.
About this listing
Published on Ashby under the board identifier Clera, which is the name the employer’s own job board carries. RoleSprint has not verified the company’s registered or trading name, so it is shown exactly as published rather than tidied up.
RoleSprint is not the employer and not a recruiter. Applications are made on the employer’s own site and never reach us; what RoleSprint does is help you decide whether a role is worth your time and prepare for it if it is.
Published 11 November 2026, last checked 3 days ago. A posting stops being advertised here 90 days after the employer published it, and one the employer takes down is marked closed rather than quietly removed.