Reduce catastrophic risks from advanced AI

The AI Risk Mitigation Fund (ARM Fund) is a non-profit aiming to reduce catastrophic risks from advanced AI through grants towards technical research, policy, and training programs for new researchers.

Grantmaking focus areas

Technical AI alignment research

Technical research can uncover dangerous capabilities before it’s too late, or enable us to design future AI systems that are easier to understand, monitor and control.

AI Policy

Good policy can ensure that governments and corporations appropriately guard against catastrophic risks.

Building AI safety research capacity

Investment has poured into AI capabilities development, yet strikingly few researchers are working on key problems in AI safety, particularly outside of major industry labs. Grants in this area aim to bring new talent into the AI safety field.

About the Fund

This fund was spun out of the Long-Term Future Fund (LTFF), which makes grants aiming to reduce existential risk. Over the last five years, the LTFF has made hundreds of grants, specifically in AI risk mitigation, totalling over $20 million. Our team includes AI safety researchers, expert forecasters, policy researchers, and experienced grantmakers. We are advised by staff from frontier labs, AI safety nonprofits, leading think tanks, and others.

Help reduce catastrophic risks from advanced AI