Skip to content
NLStart the free course
JobsBeta

AI Evaluation and Agent Systems Engineer

SyntonyRemote

View the jobThis takes you to the employer’s own site, where you apply.

Global catastrophic risksAI safetySoftware engineeringResearch

Why this is on the board

Anyone who changes an AI model or an AI agent cannot tell, without good tests, whether it then behaves more safely or more riskily. You build the tests that make this visible; researchers and product teams rerun them with every new version, though they decide what to do with the results.

This board is in beta and this is our judgement. If you think we have it wrong, tell us. Give feedback · How we reason about it

About the role

Build evaluation software for AI models and agents, testing behaviour changes and producing evidence for research and product workflows.

More about SyntonyWhy this problemGlossary

Want to understand this first?

Start with our free course: about 100 minutes in six short units, at your own pace, with no sign-up. To go further, apply for the EA Fellowship: five weeks of reading and discussion in a small group. Also free, but selective.

Start the free courseApply for the fellowship

Disagree with something here?

This board is curated by people who can be wrong. If you think a listing does not belong, if we are missing one, or if something else is off: Give feedback, or email jobs@effectiefaltruisme.nl.

Cookie settings

Choose which cookies you allow. Necessary cookies are always on because the site can't work without them.

Always on

Keep the site secure and remember your cookie choice. These don't track you.

Let Google Analytics and Microsoft Clarity show us how people use the site, such as which pages they visit and how they move around a page, so we can improve it.

Let Google and Meta measure whether our ads, such as for the EA Fellowship, reach the right people.