Clera
Founding Engineer, Environments + Data
- Compensation
- $200K–$300K / yr
- From job posting
- Location
- San Francisco, CA, US
- Arrangement
- On-site
- Employment type
- Full-time
- Posted
- 28 October 2026 (4 days ago)
Checked 3 days agoApplications go to the employer, never to RoleSprint
About this role
ABOUT THE ROLE
Build evaluation environments and benchmarks that measure whether AI agents can perform real company work and meet or exceed human performance. This founding engineering role focuses on agent capability assessment and production readiness, helping establish reliable evidence of agent competence.
WHAT YOU'LL DO
- Design synthetic company environments with realistic email, records, and files for agents to use over extended periods.
- Create robust graders and evaluation systems for assessing advanced AI agents.
- Develop benchmarks that correlate with real-world production performance.
- Identify and address evaluation failures, including reward hacking and benchmark gaming.
- Simulate software tools such as inboxes and CRMs with sufficient fidelity for agent interactions at scale.
WHAT WE'RE LOOKING FOR
- Hands-on experience with synthetic data pipelines, benchmarks, evaluations, or post-training; this role is suited to an AI researcher who builds, not a purely infrastructure-focused engineer.
- Experience building environments or benchmarks used to train or evaluate agents at advanced AI labs, and implementing graders or evaluation systems.
- At least 1 to 2 years at a fast-growing or AI-focused startup, with experience building synthetic environments or production-like simulations.
- Ability to identify flaws in established benchmarks and detect and fix reward hacking in evaluation systems.
- Experience simulating software systems that can withstand agent tool calls.
- Strong academic or equivalent credentials, such as a top-tier university background, founding experience, or participation in a leading startup program.
- High-level competition experience in mathematics, programming, debate, or games is valued.
COMPENSATION & BENEFITS
$200,000 to $300,000 annual base salary, with up to $350,000 for exceptional candidates. An additional commission-style bonus of up to $200,000 or more is tied to the value of delivered environments. Meaningful founding equity is included. Visa sponsorship is not available.
LOCATION
On-site, five days a week in San Francisco, California, United States.
Work location
- San Francisco, CA, US
Related jobs
Ready to make a decision?
This role is either worth your time or it isn’t.
Analyze the posting against your experience, see the gaps clearly, and build the right materials only if the opportunity makes sense.
Nothing is submitted automatically. You choose what happens next.
About this listing
Published on Ashby under the board identifier Clera, which is the name the employer’s own job board carries. RoleSprint has not verified the company’s registered or trading name, so it is shown exactly as published rather than tidied up.
RoleSprint is not the employer and not a recruiter. Applications are made on the employer’s own site and never reach us; what RoleSprint does is help you decide whether a role is worth your time and prepare for it if it is.
Published 28 October 2026, last checked 3 days ago. A posting stops being advertised here 90 days after the employer published it, and one the employer takes down is marked closed rather than quietly removed.