Global catastrophic risks
Operations Assistant to the COO
AI Safety AsiaRemoteRemote
At a small organisation that works with Asian governments on rules for powerful AI, the COO's time is often the tightest bottleneck.
Global catastrophic risksOperationsFinanceMid levelSenior Researcher, AI Economic Preparedness
Windfall TrustRemoteRemote
No one knows how quickly AI will change jobs and tax revenues.
AI safetyResearchPolicyMid levelRegional Principal, AI Economic Preparedness
Windfall TrustRemoteRemote
How fast AI will shift work and incomes is uncertain, but how hard it hits depends on what governments have ready in advance.
AI safetyPolicyResearchSeniorBeijing AI Safety Residency
QingZhi AI Safety HubBeijing
AI safety research currently happens mainly in the US and the United Kingdom, while Chinese companies are also building the most powerful systems.
Programme · 13 weeksAI safetyResearchSoftware engineeringMid levelConceptual Reasoning Researcher
Trajectory Labs, PBCRemoteRemote
Anyone who has AI models help think through hard questions, such as how to keep powerful AI safe and controllable, needs to know where those models sound convincing but reason badly.
AI safetyResearchSoftware engineeringMid levelResearch Resident, US
AnthropicRemote
AI safety is a small field: a method for seeing what happens inside a language model, devised by a handful of researchers, is soon used by other labs too.
Programme · 26 weeksAI safetyResearchSoftware engineeringMid levelResearch Resident, UK
AnthropicUK
Here, research into what happens inside AI models and when they go off the rails goes straight to the people who train Claude, a system used by millions of people.
Programme · 26 weeksAI safetyResearchSoftware engineeringMid levelTalent Acquisition Coordinator, Operations
Epoch AIRemoteRemote
Epoch AI publishes the figures on computing power and the growth of AI models that policymakers worldwide rely on when they draw up rules for AI.
AI safetyOperationsDataEntry levelOxford China Policy Lab Fellowship
Oxford China Policy LabOxford
How the United States and China compete on AI helps determine whether powerful AI systems are introduced carefully or hastily.
Programme · 2 weeksAI safetyResearchPolicyEntry levelSenior Ontwikkelaar / Beheerder Datastream
Ministerie van DefensieUtrechtOn site in the Netherlands
Your leverage lies in the team, not in your own code: by coaching developers and removing obstacles, you keep the data platform the Koninklijke Marechaussee, the Dutch military police and border guard, relies on for…
AI safetySoftware engineeringManagementSeniorDutch requiredWetgevingsjurist
Ministerie van Volksgezondheid, Welzijn en Sport's-GravenhageOn site in the Netherlands
What the government may do in a next pandemic, such as testing, isolating and vaccinating, is set out in the Wet publieke gezondheid, the Dutch Public Health Act, and work is now under way on its infectious disease…
Pandemics and biosecurityLegalPolicyMid levelDutch requiredTalent Acquisition Coordinator
Epoch AIRemoteRemote
Epoch AI grew from about 20 to 70 people in 2026, and policymakers worldwide use the figures on AI progress that the team publishes.
AI safetyOperationsEntry levelDC Summer Fellowship (2027)
Centre for the Governance of AI (GovAI)Washington
How the US regulates powerful AI is largely decided in Washington by a small group of policymakers, who seek advice from think tanks such as GovAI.
Programme · 13 weeksAI safetyResearchPolicyEntry levelUK Summer Fellowship (2027), Research Track
Centre for the Governance of AI (GovAI)London
GovAI is a London research institute that helps policymakers at governments and AI companies work out how to steer advanced AI in the right direction.
Programme · 13 weeksAI safetyResearchPolicyEntry levelUK Summer Fellowship (2027), Applied Track
Centre for the Governance of AI (GovAI)London
According to GovAI, the scarce people in work on rules and oversight for advanced AI are not mainly researchers, but people who organise, communicate and lead policy processes.
Programme · 13 weeksAI safetyPolicyOperationsEntry levelTeamleider programma-, project- en kwaliteitsmanagement
Autoriteit Nucleaire Veiligheid en StralingsbeschermingDen Haag (ANVS)On site in the Netherlands
The Netherlands has one regulator for nuclear safety and radiation protection, and it is growing fast.
Nuclear securityManagementOperationsSeniorTransformative AI Fund
Effective Altruism FundsRemoteRemote
Whoever works here helps decide which new researchers and projects working on the risks of advanced AI receive funding.
AI safetyFinanceMid levelSeed Grants
BlueDot ImpactRemoteRemote
This is not a job but start-up money: 20,000 to 200,000 dollars to spend six to twelve months setting up your own project in AI safety or biosecurity (preventing disasters involving pathogens), areas where few people…
Programme · 26 weeksAI safetyResearchSoftware engineeringEntry levelOperations & Programs Associate
AI Safety ConnectRemoteRemote
You won't be working on AI policy yourself.
AI safetyOperationsCommunications and outreachEntry levelOperations and Programs Associate
AI Safety Connect (AISC)Remote (Europe) (Europe (excluding UK)Remote
In a small team, the two directors' time is often the bottleneck: every hour of scheduling, travel and admin you take over is an hour they can spend on the conversations and meetings through which AI Safety Connect…
AI safetyOperationsCommunications and outreachEntry levelEvents Lead (x3)
Safe AI Netherlands (SAIN)EindhovenOn site in the Netherlands
AI safety, the work of making increasingly powerful AI systems do what we intend, is a small field, and many people find their way into it through a talk or meetup in their own city.
AI safetyCommunications and outreachOperationsEntry levelChapter Director (x3)
Safe AI Netherlands (SAIN)EindhovenOn site in the Netherlands
Few people yet work on AI safety, making sure advanced AI systems remain safe, and many got there through a course, a study group or a conversation at their university.
AI safetyManagementCommunications and outreachMid levelDutch requiredCommunications Lead (x3)
Safe AI Netherlands (SAIN)EindhovenOn site in the Netherlands
In a new city, the first channels decide who comes to the meetings and courses on AI safety — the field that tries to prevent powerful AI systems from causing serious harm.
AI safetyCommunications and outreachEntry levelResearch Scientist, Manipulation Evals
Apart ResearchRemote (EuropeRemote
A regulator can only act against AI that manipulates people once someone has shown how to measure it.
AI safetyResearchSoftware engineeringMid levelSenior beleidsmedewerker varkensgezondheid en dierziektemonitoring
Ministerie van Landbouw, Visserij, Voedselzekerheid en NatuurDen HaagOn site in the Netherlands
Whoever sets up the statutory animal disease monitoring helps determine how early the Netherlands detects an outbreak of, say, African swine fever.
Animal law and enforcementPolicyResearchSeniorDutch requiredResearch Support
AI Alignment FoundationRemoteRemote
Many ideas for keeping AI systems safe, some drawn from neuroscience or physics, stay on paper because the person who came up with them has no team to test them.
AI safetyResearchSoftware engineeringMid levelIncubator Week
BlueDot ImpactSan Francisco
Here you start something new rather than fill a vacancy: you spend five days in San Francisco working out a plan for an unsolved problem in AI safety, and if BlueDot backs it, you get up to $200,000 to turn it into an…
Programme · 1 weekAI safetyResearchPolicyEntry levelAfdelingshoofd Informatievoorziening
RIVMBilthovenDutch employer, flexible
When a new pathogen emerges, the RIVM, the Dutch national public health institute, can only respond as fast as its information systems allow.
Pandemics and biosecurityManagementOperationsSeniorDutch requiredDatamanagement expert
RIVMBilthovenDutch employer, flexible
In a major infectious disease outbreak, the Netherlands has to be able to scale up quickly.
Pandemics and biosecurityDataOperationsMid levelDutch requiredSoftware Engineer, Product
Collective Intelligence ProjectRemoteRemote
Whether ordinary people's views count in how AI is developed depends partly on practical software: how you collect, organise and summarise thousands of responses without losing the nuance.
AI safetySoftware engineeringMid levelManaging Director, Women in Safety and Ethics
Berkeley Existential Risk Initiative (BERI)RemoteRemote
AI safety, the work of keeping powerful AI systems safe and controllable, is a small field: whether someone stays in it often depends on a mentor, a network or one good conversation at a conference.
AI safetyOperationsCommunications and outreachMid levelHead of Operations
QuorumRemoteRemote
Quorum does research and policy work to keep powerful AI systems controllable, and is growing from seven to at least twenty people.
AI safetyOperationsManagementSeniorEmergent Ventures Fellowship
Mercatus Center at George Mason UniversityRemoteRemote
This is not a job but a grant: you submit an idea that does not exist yet, and if Emergent Ventures picks it, you get money to set it up, often before other funders have looked at it.
ProgrammeEffective givingFinanceEntry levelTeacher, Technical AI Safety/Governance & Strategy
ML4GoodRemoteRemote
Still relatively few people work on keeping powerful AI systems safe, and the field grows mainly through new people learning the trade.
Programme · 2 weeksAI safetyResearchCommunications and outreachMid levelPhD: new methodologies for RSV infection and immunity (English)
RIVMBilthovenOn site in the Netherlands
A test method that regulators recognise goes on being used by others for years.
Pandemics and biosecurityResearchEntry levelFellowship, Epidemiology and Public Health Microbiology
European Centre for Disease Prevention and Control (ECDC)RemoteRemote
Whether an outbreak of an infectious disease stays local often depends on how quickly someone on the ground works out where it came from and how it is spreading.
Programme · 104 weeksPandemics and biosecurityResearchPolicyEntry levelSenior Adviseur bestuurlijke zaken uitvoeringsorganisaties
Ministerie van Volksgezondheid, Welzijn en Sport's-GravenhageOn site in the Netherlands
Whether the Netherlands weathers the next pandemic well depends partly on executive agencies such as the RIVM, the national public health institute: when it really matters, will they have enough people, working IT and…
Pandemics and biosecurityPolicyManagementSeniorDutch requiredML Researcher, Post-Training and Safety
Compassion Aligned Machine LearningRemoteRemote
If you teach a language model certain values, do they hold up when someone tries to mislead it or trains the model further?
AI safetyResearchSoftware engineeringMid levelAI Evaluation and Agent Systems Engineer
SyntonyRemoteRemote
Anyone who changes an AI model or an AI agent cannot tell, without good tests, whether it then behaves more safely or more riskily.
AI safetySoftware engineeringResearchMid levelExecutive Catalyst: Ops & Strategy
SteadRiseRemoteRemote
Organisations trying to reduce serious risks from advanced AI are growing fast, but they have few people who have built an organisation before.
Programme · 12 weeksAI safetyManagementOperationsMid levelUndergraduate Intern, AI Safety Research and Engineering
SyntonyRemoteRemote
As an intern you won't solve much yourself: the value lies in what you take away.
ProgrammeAI safetyResearchSoftware engineeringEntry levelHumanitas Fellowship
SyntonyRemoteRemote
On how AI can be misused, and how to keep telling real from fake now that synthetic images are increasingly convincing, there is still little careful research for policymakers and lawyers to build on.
Programme · 35 weeksAI safetyResearchPolicyMid levelHorizon Scanner, Scalable Alignment
Principles of IntelligenceRemoteRemote
You won't do the research yourself here; instead you work out which questions in AI safety – the field that aims to keep powerful AI systems under control – nobody is taking up yet.
AI safetyResearchPolicyMid levelAI Evaluation & Agent Systems Engineer
SyntonyRemoteRemote
Anyone who wants to know whether an AI system has become safer or riskier after an update needs a reliable way to measure it.
AI safetySoftware engineeringResearchMid levelHorizon Scanner, Scalable Alignment
Principles of Intelligence (PIBBS)RemoteRemote
In a young field like AI safety, the research into how to make powerful AI systems do what people intend, the hardest part is often not the research itself but knowing which questions are solvable and who can answer…
AI safetyResearchPolicyMid levelAI Industry Associate or Lead
Future of Life Institute (FLI)Remote (Europe) (Europe (excluding UK)Remote
European governments are now settling how they deal with AI, and whoever supplies them with worked-out arguments and concrete proposals helps determine which way that goes — for example, whether fully autonomous,…
AI safetyPolicyResearchMid levelCall for expressions of interest: GPPAC Board Member
gppac.netDen HaagDutch employer, flexible
For four to six hours a month, as a board member you oversee the foundation that forms the legal and financial basis of a network of more than 300 peace organisations in 104 countries.
Democratic institutionsManagementSeniorLead datamanagement
RIVMBilthovenOn site in the Netherlands
If a new pandemic breaks out, the RIVM, the Dutch national public health institute, has to scale up within weeks: testing, vaccinating and keeping track of who has had what.
Pandemics and biosecurityDataManagementSeniorDutch requiredResearch Grants
Center on Long-Term RiskRemoteRemote
The Center on Long-Term Risk funds research into how AI and other future technology could cause suffering on a large scale — a question few researchers are working on yet.
AI safetyFinanceMid levelRapid Grants
BlueDot ImpactRemoteRemote
This is not a vacancy but a rapid grant of up to $20,000 for anyone who wants to work on AI safety or biosecurity, reducing risks from pathogens.
AI safetyResearchEntry levelCareer Transition Grants, AI Safety and Biosecurity
BlueDot ImpactRemoteRemote
This is not a job but a grant: BlueDot Impact gives between 20,000 and 200,000 dollars so that you can move full-time into work on AI safety or biosecurity, rather than trying to do so alongside your current job.
ProgrammeAI safetyResearchEntry levelScientist, Plume Modeling and Forecasting
ReflectiveRemoteRemote
Whether it is ever wise to cool the earth with particles in the stratosphere depends on a question that is still open: how does such a plume behave in its first hours and days?
AI safetyResearchEngineeringMid levelHead of Special Projects, AI Safety
QuorumRemoteRemote
AI safety is the work of preventing powerful AI systems from causing serious harm, and the field is small: researchers, AI labs, policymakers and funders often work in isolation from one another.
AI safetyManagementResearchSeniorAI Industry Associate/Lead
Future of Life InstituteRemote (Europe)Remote
Countries such as Brazil, Canada and the EU member states are working on their own AI strategies, and most tacitly assume these must centre on ever larger, more autonomous systems.
AI safetyPolicyResearchMid levelResearch Mentorship, Alignment Research
Supervised Program for Alignment Research (SPAR)RemoteRemote
Only a few experienced researchers worldwide work on the question of how to make powerful AI systems do what we intend — AI safety — and their guidance is what beginners lack most.
ProgrammeAI safetyResearchEntry levelResearch Mentor, AI Safety
PRISMRemoteRemote
You spend around 14 hours, spread over 16 weeks.
AI safetyResearchSeniorResearch Scientist, Manipulation Evals
Apart ResearchRemoteRemote
Regulators can only enforce rules for what they can measure, and whether an AI model manipulates people can still barely be measured reliably.
AI safetyResearchSoftware engineeringMid levelCommunications and Outreach, AI Safety
Cedar ResearchRemoteRemote
Research into the safety of AI systems only helps once policymakers, journalists and other researchers know about it, and small research groups rarely have someone who translates it for a broad audience.
AI safetyCommunications and outreachResearchEntry levelFacilitator, Research Fellowship
MercialRemoteRemote
Anyone starting out in AI safety research, meaning research into how to keep powerful AI systems safe, rarely gets good feedback on a first piece of work, even though that feedback often decides whether they carry on.
Programme · 4 weeksAI safetyResearchEntry levelAI Security Bootcamp, San Francisco
AI Security BootcampUSA
Anyone who steals or manipulates a powerful AI model bypasses, in one go, all the safety measures its makers built into it.
Programme · 1 weekAI safetyInformation securitySoftware engineeringMid levelAI Enablement Manager
Epoch AIRemoteRemote
Policymakers and researchers around the world use Epoch AI's figures on computing power and the growth of AI to estimate how quickly this technology is developing.
AI safetyOperationsSoftware engineeringMid levelTechnical Specialist, AI Safety
Cedar ResearchRemoteRemote
Cedar Research publishes its code, methods and papers openly, so that other research teams build on them instead of working out the same things again.
AI safetySoftware engineeringResearchMid levelFunding, AI Safety
The Global Technology Risk FoundationRemoteRemote
AI safety, the research into how to keep powerful AI systems reliable and controllable, is a young field with few people in it.
ProgrammeAI safetyResearchEntry levelResearch Fellow, AI Interpretability
GoodfireUSA
Large AI models are trained by trial and adjustment, without anyone properly understanding why they do what they do.
Programme · 13 weeksAI safetyResearchSoftware engineeringEntry levelSpecial Projects Officer, Strategy
Ambitious Impact (AIM)RemoteRemote
Ambitious Impact (AIM) helps people found new charities, and a small leadership team decides which gaps in that landscape are tackled first.
Effective careersResearchOperationsMid levelSPAR Research Manager
KairosRemoteRemote
You guide mentors who each lead a research team in AI safety: research into how to stop powerful AI systems from causing serious harm.
AI safetyResearchManagementMid levelProgram Lead, Working Groups
Responsible AIxBio CollaborativeRemoteRemote
New AI models can help malicious actors design biological weapons, while the AI labs, biotech companies and policymakers who need to stop that rarely sit at the same table.
AI safetyManagementPolicySeniorOperations Lead
Talos NetworkRemoteRemote
Talos Network prepares people for policy work on AI in Europe: who gets control over this technology and what rules apply to it.
AI governance and powerOperationsFinanceSeniorHead of Operations
PRISM GlobalRemoteRemote
PRISM Global researches whether AI systems can experience anything, a question few people yet work on full time.
AI safetyOperationsManagementSeniorCo-Founder
Responsible AIxBio CollaborativeRemoteRemote
Companies building AI models for biological research do not yet have shared agreements to prevent misuse for biological weapons, and they rarely sit down together to discuss it.
Pandemics and biosecurityPolicyManagementExecutiveGeneralist, SPAR
KairosRemoteRemote
SPAR pairs people who want to start out in AI safety, the research into how to keep powerful AI systems safe, with experienced mentors.
AI safetyOperationsManagementMid levelChief of Staff
Responsible AIxBio Collaborative (R-ABC)RemoteRemote
R-ABC is a new non-profit that wants to use rules and agreements to stop anyone using AI to make a biological weapon or unleash a pandemic.
Pandemics and biosecurityOperationsManagementSeniorSenior AI Governance Grantmaker
Effective Institutions ProjectRemoteRemote
In this role you help decide where tens of millions of dollars go in a young field with few funders: the rules and institutions around powerful AI, and the question of who gets power over it.
AI governance and powerFinancePolicySeniorSPAR Research Manager
KairosRemoteRemote
You won't do research yourself, but you help the people who lead it: many of SPAR's 250 mentors are leading a team for the first time, and together they guide more than 800 newcomers to AI safety each round, the field…
AI safetyManagementResearchMid levelHead of Engineering, Red Team
FAR AIRemoteRemote
AI labs and governments let FAR.AI attack their newest models before they are released.
AI safetySoftware engineeringManagementSeniorRecruiter
KairosRemoteRemote
Kairos expects to double in size within six months, and each new hire runs programmes that hundreds of people pass through on their way to working on AI safety: the field that aims to prevent powerful AI systems from…
AI safetyOperationsCommunications and outreachMid levelResearch Engineer
IliadRemoteRemote
At Iliad, people research how to make powerful AI systems do what humans intend, and their pace often depends on how quickly rough test code becomes a reliable computation at scale.
AI safetySoftware engineeringResearchMid levelProof Engineer, Autoformalisation Engineer
IliadRemoteRemote
Mathematical research on the safety of AI systems depends on proofs that actually hold, and checking them by hand can cost researchers months.
AI safetySoftware engineeringResearchMid levelAlignment Fellow
Arcadia ImpactLondon
Large AI companies know a lot about the techniques they use to make their models do what is intended, but those on the outside see little of it.
Programme · 13 weeksAI safetyResearchSoftware engineeringEntry levelTechnical Grant Writer
AI Alignment FoundationRemoteRemote
AI safety researchers, who work out how to make powerful AI systems do what people intend, often write their own grant applications, and that comes out of their research time.
AI safetyCommunications and outreachResearchMid levelHead of Engineering (Red Team)
FAR AIRemote (International)Remote
FAR AI tests new AI models from OpenAI and Anthropic, among others, before they are released, and does the same for governments such as the European Commission: the team deliberately tries to make the systems go off…
AI safetySoftware engineeringManagementSeniorFunding for Programs and Events
Coefficient GivingRemoteRemote
Note: this is not a vacancy but an ongoing grant scheme from Coefficient Giving, formerly Open Philanthropy, one of the largest funders of work on major global risks.
Community buildingFinanceMid levelHead of Projects
Safe AI Netherlands (SAIN)AmsterdamOn site in the Netherlands
Many people take a course on AI safety — the field that tries to get powerful AI systems to do what we intend — and then get no further than reading.
AI safetyManagementResearchSeniorResearch Scientist
AI Verification and Evaluation Research Institute (AVERI)RemoteRemote
Lawmakers want powerful AI systems to be independently scrutinised, but how to carry out such an audit technically is still largely an open question.
AI safetyResearchSoftware engineeringMid levelCoordination and Accountability
Foresight InstituteRemoteRemote
More and more AI systems are working with each other and with people without any single party overseeing them, and how to make that safe is largely unknown.
AI safetyResearchSoftware engineeringMid levelProduct Manager
Survival and Flourishing Fund (SAF & SFF)RemoteRemote
The Survival and Flourishing Fund distributes money across dozens of organisations every year, and the people who decide where it goes work with software that you, as product manager, improve.
Global catastrophic risksOperationsManagementMid levelProduct Manager, Website
Epoch AIRemoteRemote
Policymakers, journalists and researchers who want to know how fast AI is progressing often get their figures from Epoch AI, and the website is where they find them.
AI governance and powerCommunications and outreachDataMid levelEvents Team Member, Facilitator
Safe AI NetherlandsNetherlandsOn site in the Netherlands
Still only a few people work on the question of how to keep powerful AI systems safe, and some of them got involved through a reading group or course like this one.
AI safetyCommunications and outreachEntry levelEducation Lead, Technical and Repository Owner
Safe AI NetherlandsNetherlandsOn site in the Netherlands
In the Netherlands relatively few people work on AI safety, the research into how to keep powerful AI systems safe and controllable.
AI safetyResearchSoftware engineeringSeniorMultiple roles in AI x Global Health and Wellbeing
Coefficient GivingRemote - GlobalRemote
This new team decides which projects at the intersection of AI and global health receive up to €100 million in grants over the coming year.
Global health and infectious diseaseResearchFinanceMid levelScience and Technology Policy Fellow, Legislative Branch Cohort in AI
American Association for the Advancement of Science (AAAS)Washington
Members of the US Congress decide on AI legislation, yet their offices rarely have anyone who understands the technology itself.
Programme · 2 weeksAI safetyPolicyResearchEntry levelDutch nationality requiredRecruiter or Senior Recruiter
Epoch AIRemoteRemote
Epoch AI is a small research institute that tracks in numbers how fast AI is advancing, such as compute and scaling, and policymakers and researchers worldwide use those numbers.
AI safetyOperationsCommunications and outreachMid levelSenior Advisor, Advanced Guardrails for AI-Induced Incidents
Institute for Security and Technology (IST)RemoteRemote
Governments have barely any playbook for the moment an AI system unexpectedly slips out of human control.
AI safetyResearchPolicySeniorProactive Cyber Defence and Engineering
Booking.comAmsterdamDutch employer, flexible
The work itself protects one company; the leverage is in what you earn and what you learn.
AI safetyInformation securityManagementSeniorTech Lead Manager, GPU Cluster Infrastructure
FAR AIRemote (International)Remote
FAR.AI's researchers test frontier models for OpenAI and the EU AI Office, but that work grinds to a halt as soon as the GPU cluster falters.
AI safetySoftware engineeringManagementSeniorSenior Software Engineer, GPU Cluster Infrastructure
FAR AIRemote (International)Remote
FAR AI tests AI systems before they are released, for OpenAI and the EU AI Office — and that research runs on a GPU cluster that grew from tens to hundreds of cards this year.
AI safetySoftware engineeringInformation securitySeniorRequest for Proposals: Project Tailwind
Coefficient GivingRemoteRemote
This is not a vacancy but a funding round: Coefficient Giving (formerly Open Philanthropy) is looking for people to set up a new organisation or research group in AI safety, the work meant to ensure powerful AI systems…
ProgrammeAI safetyManagementResearchEntry levelEvents Lead
Safe AI NetherlandsAmsterdamOn site in the Netherlands
AI safety is a small field.
AI safetyCommunications and outreachOperationsEntry levelEducation Course Facilitator
Safe AI NetherlandsNetherlandsOn site in the Netherlands
Few people yet work on AI safety — making sure increasingly powerful AI systems stay under control — and for many participants this course is the first step towards that work.
AI safetyCommunications and outreachResearchEntry levelIliad Intensive
IliadUK
Research into how to keep powerful AI systems safe and predictable (AI safety) is a young field, and only a few people are working on its basic mathematical questions.
Programme · 4 weeksAI safetyResearchSoftware engineeringEntry levelIliad Fellowship
IliadUK
AI safety, the study of how to make powerful AI systems reliably do what people intend, is a young field with few mathematicians.
Programme · 26 weeksAI safetyResearchSoftware engineeringEntry levelQA or Testing Engineer
Survival and Flourishing Fund (SAF & SFF)RemoteRemote
The Survival and Flourishing Fund distributes millions each year among organisations working on the greatest risks to humanity, and its evaluators weigh applications in its own software.
Global catastrophic risksSoftware engineeringDataMid levelFull-Stack Software Engineer
Survival and Flourishing Fund (SAF & SFF)RemoteRemote
The Survival and Flourishing Fund distributes money across dozens of organisations through its own procedure, in which formulas combine the judgements of several evaluators into a single allocation.
Global catastrophic risksSoftware engineeringMid levelTeacher, Teaching Assistant, or Writer
IliadRemoteRemote
Only a few people work on the question of how to make powerful AI systems do what we intend, and the field grows mainly through new people learning it.
AI safetyResearchCommunications and outreachMid levelSummer Research Fellowship (Legal Frontiers)
Institute for Law & AIRemoteRemote
Legislators in the US, the EU and the UK are writing rules for AI now, but how you make an AI system follow the law is a question few lawyers are working on yet.
Programme · 10 weeksAI safetyLegalResearchEntry levelHead of Operations
SASHRemoteRemote
SASH researches AI safety: how to keep increasingly powerful AI systems reliable and under human oversight.
AI safetyOperationsManagementSeniorLead Research Scientist
Neo ResearchRemoteRemote
As research lead you decide which questions a whole team investigates, and which are left aside.
AI safetyResearchSoftware engineeringSeniorHead of Operations
Singapore AI Safety Hub (SASH)Remote (LondonRemote
In a young, fast-growing organisation, whoever sets up recruitment, salaries and security determines how many researchers and policy people can genuinely spend their time making the most powerful AI systems safer.
AI safetyOperationsManagementSeniorEducation Course Facilitator, Utrecht
Safe AI Netherlands (SAIN)UtrechtOn site in the Netherlands
AI safety – the work of keeping powerful AI systems safe and controllable – is a small field, and for many people a course like this is the first step into it.
AI safetyResearchCommunications and outreachEntry levelEvents Lead, Amsterdam
Safe AI Netherlands (SAIN)AmsterdamOn site in the Netherlands
AI safety is the field that studies how to keep increasingly powerful AI systems safe and controllable, and few people work on it compared with the questions still open.
AI safetyCommunications and outreachOperationsEntry levelEducation Lead
Safe AI Netherlands (SAIN)UtrechtOn site in the Netherlands
Relatively few people work on AI safety, making sure powerful AI systems do what we intend.
AI safetyCommunications and outreachResearchMid levelCommunity Manager, Amsterdam
Safe AI Netherlands (SAIN)AmsterdamOn site in the Netherlands
AI safety — making sure increasingly powerful AI systems stay safe and do what we intend — is a small field in the Netherlands, and people who want to get into it often don't know where to start.
AI safetyCommunications and outreachOperationsEntry levelSenior Machine Learning Scientist - Agentic Modelling Team
Booking.comAmsterdamOn site in the Netherlands
This work is about AI agents that book travel, not about preventing disasters caused by AI.
AI safetySoftware engineeringResearchSeniorExpression of Interest in a Future Role
Sentinel BioUKDutch employer, flexible
In this role you don't do research yourself, but you help decide which research gets done.
Pandemics and biosecurityFinancePolicyMid levelResearch Scientist, Member of Technical Staff
AI DigestRemoteRemote
Governments and safety teams are already making decisions about AI systems that carry out tasks on their own, while what those systems do in practice is still poorly understood.
AI safetyResearchSoftware engineeringMid levelSummer Fellowship (US)
Institute for Law & AIUSA
The law around AI is being written now, while only a few lawyers are engaging with it seriously.
Programme · 12 weeksAI safetyResearchPolicyEntry levelSummer Fellowship
Institute for Law & AI (LawAI)Washington
Few lawyers know both the law and AI well, while governments are drawing up the rules for that technology right now.
Programme · 12 weeksAI safetyLegalResearchEntry levelSenior data engineer
Autoriteit Nucleaire Veiligheid en StralingsbeschermingDen Haag (ANVS)On site in the Netherlands
The ANVS is the only body in the Netherlands that sets and enforces rules for nuclear power plants, radioactive waste and radiation sources in hospitals.
Nuclear securitySoftware engineeringDataSeniorDutch requiredShortform Video Creator
AI DigestRemoteRemote
Most people form their picture of AI not from research reports but from what turns up on their phone.
AI safetyCommunications and outreachSoftware engineeringEntry levelResearch Scientist
AI DigestRemoteRemote
Most AI tests measure what a model does in a single short task.
AI safetyResearchSoftware engineeringMid levelEngineer
AI DigestRemoteRemote
AI Village shows in a public livestream what the latest AI agents do when they pursue a goal on their own for hours, including where they get stuck or do something unexpected.
AI safetySoftware engineeringEntry levelDesign Engineer
AI DigestRemoteRemote
In the AI Village, AI agents work independently on tasks for long stretches, and what happens there shows what these systems can already do and where they go off the rails.
AI safetySoftware engineeringCommunications and outreachMid levelExpression of Interest: Special Projects Associate
Epoch AIRemoteRemote
Epoch AI's figures on compute and scaling are cited by policymakers and researchers worldwide; you don't do that research yourself, but you make sure a small team can publish more by coordinating experts, licensing…
AI safetyOperationsResearchEntry levelReporting Grants & Fellowships
Pulitzer CenterRemoteRemote
Some big problems almost nobody writes about, and what stays unknown rarely gets money or policy.
ProgrammeEffective givingCommunications and outreachResearchEntry levelAI Safety Residential Community
Centre for Enabling EA Learning & Research (CEEALAR)UK
CEEALAR pays for your room and board in Blackpool (England), so that you can work full-time on AI safety for six weeks to a year: preventing powerful AI systems from causing serious harm.
Programme · 26 weeksAI safetyResearchEntry levelVice President, The AI Access Initiative
Evidence ActionRemoteRemote
Evidence Action only takes a programme to millions of people once the evidence is there.
Global health and infectious diseaseManagementPolicySeniorAIXI Labs Research Fellowship
AIXI LabsRemoteRemote
A lot of AI safety research is mathematically rigorous but too narrow, or practically usable but too opaque to base hard safety claims on.
Programme · 13 weeksAI safetyResearchSoftware engineeringEntry levelResearch Fellows Program
TimaeusRemoteRemote
Tenured mathematicians and physicists rarely work on the question of what happens inside an AI model during training, even though their fields, such as algebraic geometry or statistical physics, seem to have exactly…
Programme · 52 weeksAI safetyResearchSoftware engineeringMid levelProgram Lead, Career Transition Grants
BlueDot ImpactRemoteRemote
Anyone who wants to move into AI safety, the research into how to keep increasingly powerful AI systems safe and controllable, often has to retrain for months without an income, and that holds suitable people back.
AI safetyFinanceManagementMid levelAI Offense-Defense Dynamics Lead Researcher
Future of Life FoundationRemoteRemote
Whether a new AI system mainly strengthens attackers or defenders probably depends on properties you can measure in advance, such as how broadly it can be used and how easily anyone can get access to it.
AI safetyResearchPolicySeniorSenior Technical Specialist, AI Risk Assessment
Future of Life FoundationRemoteRemote
Whoever decides how the risks of advanced AI are measured helps decide what governments, researchers and funders pay attention to.
AI safetyResearchPolicySeniorResearch Engineer, Novel AI Platforms for Multiscale Alignment
Future of Life FoundationRemoteRemote
Many ideas for getting AI systems to work together safely still exist mostly on paper, because there is no good environment to test them in.
AI safetySoftware engineeringResearchMid levelFunding for Addressing Risks From Transformative AI
Coefficient GivingRemoteRemote
This is less a job than a rolling grant scheme: you apply to Coefficient Giving (formerly Open Philanthropy, one of the largest philanthropic funders in this area) for money for a course, fellowship, event or podcast…
AI safetyFinanceMid levelRecruiter / Senior Recruiter
Epoch AIRemoteRemote
Epoch AI publishes the figures on computing power and AI trends that policymakers and researchers worldwide fall back on.
AI safetyOperationsCommunications and outreachMid levelSenior Researcher, Civil Safety Sciences
Future of Life FoundationRemoteRemote
For many hazards that AI makes possible, such as synthetic microbes or new ways of spreading pathogens, there is as yet no field of study and no historical precedent to lean on.
AI safetyResearchPolicySeniorGeneral Expression of Interest (EOI)
KairosRemoteRemote
Kairos does no AI safety research itself, but trains the people who will: more than 1,200 participants in two years, through fellowships and student groups.
AI safetyManagementCommunications and outreachEntry levelHead of Talent Operations
KairosRemoteRemote
Kairos trained more than 1,200 people in two years, but nobody systematically matches early-career researchers with open positions at AI safety organisations.
AI safetyOperationsManagementSeniorSPAR Research Manager
KairosRemoteRemote
Each round, SPAR pairs more than 400 early-career researchers with 130 mentors at places such as Anthropic, RAND and the UK AI Security Institute.
AI safetyManagementOperationsMid levelGeneralist (Talent Ops)
KairosRemoteRemote
Kairos trained more than 1,200 people for work on AI safety in two years, and is growing from 7 to around 20 staff.
AI safetyManagementOperationsMid levelAI Safety Argumentation Platform Research Engineer
Future of Life FoundationRemoteRemote
Anyone who has to make decisions about the risks of AI currently gets mostly separate reports and opinions that contradict each other.
AI safetySoftware engineeringResearchMid levelExpressions of Interest
Mirror Biology Dialogues FundRemoteRemote
Mirror life (organisms built from mirrored versions of the molecules of all natural life) does not exist yet, but 38 scientists warned in Science in December 2024 that a mirror bacterium could cause unprecedented harm…
ProgrammePandemics and biosecurityResearchEntry level
What do you make of this?
The board is still in beta, so this is exactly the moment to say what you think. A vacancy we have missed, a judgement you do not share, something that does not work — all of it helps.
Want to understand this first?
Start with our free course: about 100 minutes in six short units, at your own pace, with no sign-up. To go further, apply for the EA Fellowship: five weeks of reading and discussion in a small group. Also free, but selective.