Clera
Research Engineer, Benchmarks
- Compensation
- $150K–$250K / yr
- From job posting
- Location
- Singapore, SG
- Arrangement
- On-site
- Employment type
- Full-time
- Posted
- 26 September 2026 (4 days ago)
Checked 4 days agoApplications go to the employer, never to RoleSprint
About this role
ABOUT THE ROLE
This is a hands-on research engineering role focused on designing and owning high-quality benchmarks that evaluate frontier AI agents on realistic, domain-specific workflows. You will sit within a small, highly technical team and play a critical part in ensuring evaluations are rigorous, credible, and trusted by leading AI labs and customers.
WHAT YOU'LL DO
- Design, implement, and own the quality of internal benchmarks for evaluating frontier agents on domain-specific tasks.
- Partner with subject-matter experts to define realistic workflows and translate them into benchmark tasks and evaluation criteria.
- Build and operate reliable infrastructure to run models and agents against benchmark tasks at scale.
- Develop metrics and statistical analyses that measure benchmark difficulty, reliability, and failure modes.
- Validate that benchmark performance correlates with real-world evaluations, customer needs, and frontier lab expectations.
- Write clear technical documentation and benchmark reports for research and engineering audiences.
WHAT WE'RE LOOKING FOR
- 2 to 4 years of experience in software engineering, ML engineering, or research roles, with a focused track record in AI benchmarks or evaluation infrastructure.
- Strong proficiency in Python, Docker, and Linux environments.
- Demonstrated experience designing, implementing, and running benchmarks or evaluation environments for AI agents or large language models.
- Experience building infrastructure to reliably run AI models or agents against benchmark or evaluation tasks.
- Ability to analyze and model workflows across diverse technical or business domains to support task design.
- Sharp attention to detail with a habit of spotting subtle inconsistencies and edge cases.
- Comfort reasoning from first principles about task design, scoring, and failure modes.
- Strong written communication skills; experience producing technical documentation or benchmark reports.
- Ability to thrive in unstructured problem spaces at an early-stage startup.
- Bonus: experience with reinforcement learning pipelines, data generation, or RL agent evaluation; published work on AI benchmarking or model evaluation.
COMPENSATION & BENEFITS
Salary range: USD 150,000 to 250,000 annually. Visa sponsorship is available.
LOCATION
On-site in Singapore.
Work location
- Singapore, SG
Related jobs
Ready to make a decision?
This role is either worth your time or it isn’t.
Analyze the posting against your experience, see the gaps clearly, and build the right materials only if the opportunity makes sense.
Nothing is submitted automatically. You choose what happens next.
About this listing
Published on Ashby under the board identifier Clera, which is the name the employer’s own job board carries. RoleSprint has not verified the company’s registered or trading name, so it is shown exactly as published rather than tidied up.
RoleSprint is not the employer and not a recruiter. Applications are made on the employer’s own site and never reach us; what RoleSprint does is help you decide whether a role is worth your time and prepare for it if it is.
Published 26 September 2026, last checked 4 days ago. A posting stops being advertised here 90 days after the employer published it, and one the employer takes down is marked closed rather than quietly removed.