← AI Safety Orgs

Berkeley Existential Risk Initiative (BERI)

Field-Building

Operational support for researchers.

Founded
2017
HQ
Covina, CA (mailing); operations Berkeley, CA
Team
19
Structure
501(c)(3) nonprofit
Model
Grants

Theory of Change

BERI's theory of change is operational leverage on university x-risk research. In their words: "BERI aims to act as a multiplier on the efficiency and impact of existing university research groups." They explicitly state: "BERI is not a donor or a grantmaker... BERI's primary role is not as a source of funding, but rather as a tool to more effectively use external funding."

The model has two components, articulated by former ED Sawyer Bernath:

  1. "Best of both worlds": Universities have resources (funding, prestige, infrastructure) but also bureaucratic obstacles. BERI removes the obstacles so researchers get the benefits without the costs. "I don't want them to leave academia for industry just to get better operations support for their work."

  2. "Comparative advantage": Researchers should research, ops people should handle ops. BERI shifts administrative burden from researchers to dedicated support staff.

The underlying intellectual framework comes from founder Andrew Critch, who views existential risk as most likely arising from "externalities, between interacting systems that somehow were not designed to interact well enough because they had different designers." Supporting independent university research groups -- rather than lab-internal safety teams -- is consistent with this view.

BERI has never published a formal theory of change document. Their 2024 goals post stated: "In lieu of publishing an annual strategic plan or theory of change, we are choosing to publish these specific goals."

What They Do

BERI provides operational infrastructure to 37+ university research collaborations globally (11 main, 4 fiscal sponsorships, ~18+ trial collaborations). Services include:

  • Hiring: Research assistants, ML engineers, translators, designers -- at salaries universities often cannot match for non-tenure-track roles
  • Purchasing: Equipment, software subscriptions, compute, travel, office snacks
  • Administrative support: Event coordination, hiring rounds, immigration assistance, Uber accounts
  • Fiscal sponsorship: For projects like MATS (until 2024), Oxford China Policy Lab, ILINA Program

Collaborations span UC Berkeley (CHAI, CLTC, InterACT), MIT, Stanford, Oxford, Cambridge, Princeton, UMass Amherst, UChicago, ETH Zurich, and more. BERI employs ~15 staff embedded directly within partner research groups, plus 3 FTE core staff and 1 contract bookkeeper.

Trial collaboration pipeline: BERI invests $1-10K in new groups, tests fit, then raises collaboration-specific funding from donors if the trial succeeds. In 2023, 14 new trials were added -- the largest cohort ever, funded by Jaan Tallinn via SFF. Six or more trials have converted to main collaborations.

Major accomplishments:

  • Fiscally sponsored MATS program (2021-2024, ~$6.3M channeled), which grew into an independent 501(c)(3) -- a successful incubation
  • Anthony Barrett's AI Risk-Management Standards Profile at CLTC (NIST AI RMF applied to frontier models), endorsed by Google DeepMind, FLI, GovAI, CAIS, FAS
  • Supported Sculpting Evolution at MIT until it became SecureBio (another successful incubation)
  • Supported FHI at Oxford until Oxford shut it down in April 2024
  • Returned all FTX Future Fund money ($389,745) in full, refusing a lower settlement, to "ensure that BERI does not benefit from theft or fraud in any way"
  • 2024 collaborator survey: 4.74/5.0 satisfaction; 44% of projects would not have happened without BERI (up from 35% in 2022)

Key People

Andrew Critch (founder): PhD Math UC Berkeley; co-founded CFAR (2011-12); MIRI research fellow (2015-17); quant trader Jane Street (2014-15); CHAI researcher (2017-present, ~1 day/week). Now CEO of Encultured AI/HealthcareAgents (for-profit, full-time). Volunteers ~1hr/month at BERI with $0 compensation. His worldview: P(treacherous turn) ~10%; multi-stakeholder coordination failures are the primary x-risk mechanism; most public AI risk discourse is "incorrect and optimized for attention." He has largely stepped back from BERI.

Elizabeth Cooper (Executive Director since November 2024): Tech startup Chief of Staff background; BA Economics and Peace/War/Defense from UNC; visiting researcher at CSER Cambridge. Joined BERI February 2023. Now simultaneously ED and President of the Board. No public statements on AI safety.

Team size: 3 FTE core staff + ~15 embedded staff + 1 contract bookkeeper. Bernath (former ED) remains on the board and now works at Tarbell Center for AI Journalism.

Money and Incentives

Revenue (recognized): $8.3M (2017), $1.7M (2018), $0.9M (2019), $2.0M (2020), $2.8M (2021), $6.9M (2022), $7.3M (2023), $5.8M (2024). Total contributions received are much higher due to pass-through fiscal sponsorship (e.g., $19.5M in contributions in 2023 vs $7.3M revenue).

Funding sources:

  • Jaan Tallinn (direct + via SFF): >$7M since founding. Single largest individual donor. Also co-founder of Critch's for-profit Encultured AI.
  • Open Philanthropy/Coefficient Giving: $13.16M across 31 grants (2017-2025). Largest category: MATS (~$6.3M, now independent).
  • Survival and Flourishing Fund: >$1.6M in S-process grants. SFF was itself seeded from BERI's grants program with $2M of Tallinn's money.
  • FTX Future Fund: $393K (returned in full, January 2024).
  • Long-Term Future Fund: ~$385K (InterACT, ALL conversions).
  • Open Phil + Tallinn/SFF = 84% of all income since founding. BERI acknowledges this creates a "precarious position."

Business model: BERI charges ~10-15% per-project overhead on collaboration-specific grants (down from ~40% in early years). Core operations are funded through this overhead. BERI does not do separate overhead fundraising -- each funder pays the overhead on their specific project. Rationale: "Funders 1 through 5 will usually be in a better position than Funder 6 to evaluate whether it's worth paying BERI's overhead rate."

Compensation: Critch takes $0. Highest paid: Anthony Barrett $213K (2024). Executive compensation total: $692K (2024). Net assets: $4.5M (2024).

Incentive concerns:

  • 84% donor concentration from two sources makes BERI existentially vulnerable to funder preference changes
  • MATS' independence removes ~48% of CG grant volume; 2024 revenue already declined 20% vs 2023
  • Critch-Tallinn-SFF-BERI-CFAR nexus: same small group influences funding decisions across multiple interconnected entities (Critch recused from CFAR grant; SFF S-process uses independent recommenders)
  • No commercial AI lab ties or compute dependencies (unlike research orgs)

What Others Say

No external public criticism of BERI exists. Extensive searching across multiple formulations found nothing. This could reflect that BERI is genuinely non-controversial, that infrastructure intermediaries do not attract attention, that the org is too small to be worth criticizing, or that the x-risk community does not publicly critique organizations funded by its shared major donors.

Collaborators say (from 2024 survey):

  • "BERI staff speak plainly and act on their words... enabling in days (or hours) what would cost weeks or months to shepherd through University processes"
  • "So responsive, genuine problem solvers, feels like they genuinely are invested in our group"
  • One concern: "I worry we build [our group] dependent on / accustomed to BERI resource support... which, should BERI lose funding, would disappear"

Structural critiques (constructed from evidence, not published externally):

  • Does a 10-15% overhead intermediary add enough value vs. direct funding to universities? BERI's own rebuttal: 44% of projects would not have happened at all.
  • The Critch-Tallinn network creates a web of interlocking relationships. Managed with recusals and multi-recommender processes, but structural concentration remains.
  • BERI granted $75K to Leverage Research in 2018, which later faced serious allegations. The grants program was subsequently wound down.

What's Absent

  • No published theory of change document -- ever
  • No public statements from new ED Elizabeth Cooper on AI safety or BERI's strategic direction
  • No external evaluation of BERI's impact or value-for-money
  • No published selection criteria for choosing collaborations
  • No resolution of 2024 predictions (despite publishing them)
  • No data on trial collaboration failure rates (only successes reported)
  • No assessment of whether supported research groups produce impactful safety work
  • Cooper serves as both ED and Board President, with only two other board members -- limited independent oversight

Recommended Reading

  1. Andrew Critch on ARCHES (FLI AI Alignment Podcast, 2022) -- https://futureoflife.org/podcast/andrew-critch-on-ai-research-considerations-for-human-existential-safety/ -- Most candid exposition of the founding worldview. Multi-stakeholder externalities as primary x-risk mechanism, commercial incentives vs. neglected problems, delegation vs. alignment. ~21,000 words of unfiltered Critch.

  2. BERI's Goals and Predictions for 2024 -- https://existence.org/blog/beris-goals-and-predictions-for-2024-1 -- Reveals BERI's self-assessment: 84% donor concentration, scalability crisis, plans to diversify. Published quantified predictions are rare and commendable.

  3. Andrew Critch: What AGI might look like in practice (Existential Hope podcast, ~2025) -- https://www.existentialhope.com/podcasts/andrew-critch -- Critch's evolved thinking: P(treacherous turn) ~10%, "products > narratives," critique of the AI safety discourse. Shows how far the founder has moved from infrastructure work to product building.

  4. 2024 Collaborator Survey Results -- https://existence.org/2024/03/01/2024-collab-survey.html -- Primary impact evidence. Quantitative satisfaction data plus qualitative feedback on what BERI does well and what's missing.

  5. BERI Overhead (blog post, 2021) -- https://existence.org/blog/2021-01-27-beri-overhead -- Clearest explanation of the financial model. Sophisticated incentive reasoning about why per-project overhead is better than centralized funding.

Show Claude’s analysis
An opinionated read. Read the brief first to form your own view.

Stated Theory of Change

BERI removes bureaucratic friction from university x-risk research. The causal chain:

  1. University researchers work on existential risk reduction
  2. University administrative systems create obstacles (slow hiring, inflexible purchasing, rigid salary scales)
  3. BERI fills these gaps by hiring staff, buying equipment, and handling admin outside university channels
  4. Researchers spend more time on research and less on bureaucracy
  5. Research output increases, contributing to x-risk reduction

BERI explicitly disclaims deeper strategic ambitions: "BERI is not a donor or a grantmaker." They provide infrastructure, not direction. The selection of which research groups to support is the closest thing to a strategic bet, but the criteria are opaque ("collective judgement of BERI's Board of Directors, with influences from advisors and trusted sources of funding").

The intellectual foundation comes from founder Andrew Critch, whose ARCHES paper argues that existential risk arises primarily from multi-stakeholder coordination failures -- externalities between AI systems and organizations that nobody is specifically responsible for preventing. Supporting independent university research (as opposed to industry safety labs) is consistent with this: university groups are less captured by commercial incentives and can study the coordination problems that labs have no incentive to solve.

Revealed Theory of Change

BERI's actions largely match their stated theory, with some significant additions:

Consistent with stated theory: The collaboration program operates as described. Survey data suggests real value. The overhead model is well-designed. BERI grows modestly and avoids scope creep (they actually narrowed from grants to collaborations in 2020).

Beyond stated theory: BERI has repeatedly incubated things that grow independent -- MATS ($6.3M channeled, now a standalone 501(c)(3)), Sculpting Evolution (became SecureBio), and arguably SFF (seeded from BERI's grants program). This "launch and release" pattern is not in their official description but may be their highest-impact activity. Providing a legal and administrative home for nascent x-risk projects until they can stand alone is a distinct and valuable function.

Divergence from stated theory: The founder's trajectory tells a different story than the org's. Critch spent 2017-2021 deeply involved with BERI, then shifted full-time to a for-profit AI company (Encultured AI/HealthcareAgents, co-founded with Jaan Tallinn). He now spends 1hr/month at BERI. This could indicate that Critch decided the infrastructure model was working well enough to leave in others' hands, or that he found the model insufficient and moved to what he considers higher-impact work ("products > narratives"). His recent emphasis on building products and his critique that "most public AI risk discourse is incorrect" suggest some disillusionment with the research support model.

Key Assumptions

1. University research groups are doing work that reduces x-risk.

  • Evidence for: CHAI (Stuart Russell), CSER, David Krueger's lab, InterACT, Barrett's standards work -- these are recognized safety-relevant groups
  • Evidence against: BERI does not assess research quality or impact; some collaborations (GreenEarth Social, Social Science Prediction Platform) have unclear x-risk connections; trial collaborations are evaluated on "compatibility" not impact
  • Testable? Partially -- could assess publication output, citations, and downstream impact of supported researchers
  • If wrong: BERI is efficiently supporting work that does not reduce x-risk, which means the overhead (however lean) is wasted

2. Operational friction is a meaningful bottleneck for university x-risk research.

  • Evidence for: 44% of projects would "not have happened" without BERI; collaborator survey praises speed and flexibility; university bureaucracies are genuinely slow for non-standard requests
  • Evidence against: 60% of projects would have happened anyway, just more slowly; the actual dollar amounts per trial collaboration ($1-10K) are very small; major research projects are constrained by ideas and talent, not by whether someone can buy snacks or Uber rides quickly
  • Testable? Yes -- compare research output before and after BERI engagement
  • If wrong: BERI provides convenience, not impact. Researchers would adapt to working within university systems and produce similar output.

3. The 10-15% overhead is justified by the value BERI adds.

  • Evidence for: Overhead rate competitive with fiscal sponsors; BERI has reduced it from 40% to ~10-15%; per-project overhead creates good incentive alignment
  • Evidence against: No comparison to direct funding alternatives; funders could theoretically give directly to universities with an admin budget
  • Testable? Yes -- funders could experiment with direct vs. BERI-mediated grants
  • If wrong: BERI is a well-intentioned but unnecessary middleman

4. BERI can survive post-MATS and maintain relevance.

  • Evidence for: 2024-2025 CG grants continue (AI governance, InterACT, standards); new collaborations being added; team growing from 1 to 3 FTE core
  • Evidence against: Revenue dropped 20% in 2024; 84% donor concentration unresolved; no evidence the new-donor goal was met
  • Testable? Will be clear within 1-2 years
  • If wrong: BERI contracts to a small org managing a handful of CHAI and CLTC collaborations

Strengths

  1. Lean and efficient: 3 FTE managing 37+ collaborations with 10-15% overhead. Very low administrative bloat.
  2. Demonstrated incubation value: MATS and SecureBio both grew through BERI's fiscal sponsorship into independent orgs -- a concrete track record of value creation.
  3. High collaborator satisfaction: 4.74/5.0, with strong qualitative feedback about speed, responsiveness, and lack of bureaucracy.
  4. Ethical integrity: Returned all FTX money ($389K) in full; Critch takes $0; strong transparency practices for org size (audited financials, published bylaws, public donor list).
  5. Sophisticated financial model: Per-project overhead reasoning is economically sound and creates better incentives than centralized overhead funding.
  6. Global university network: Connections across Berkeley, MIT, Stanford, Oxford, Cambridge, Princeton, ETH Zurich, and more -- a unique position in the x-risk ecosystem.
  7. CLTC AI Standards work: Barrett's NIST AI RMF profile for GPAIS is a tangible policy output with real-world adoption and industry endorsement.

Weaknesses and Risks

  1. Critical funding concentration: 84% from two sources (Open Phil + Tallinn). This is an existential vulnerability for BERI itself. If either funder deprioritizes them, the org could collapse within a year.
  2. Founder disengagement: Critch at 1hr/month means the intellectual engine behind BERI is gone. The current leadership (Cooper) has operations expertise but no visible AI safety vision or public engagement.
  3. Governance weakness: ED and Board President are the same person (Cooper), with only 2 other board members. Limited independent oversight for an org managing millions.
  4. No strategic quality control: BERI does not evaluate whether the research it supports is high-quality, impactful, or actually reducing x-risk. They provide services to groups selected by opaque criteria.
  5. Post-MATS revenue cliff: Losing ~48% of CG grant volume with MATS' independence. 2024 revenue already declined 20%. Sustainability of current scale is uncertain.
  6. Network concentration of influence: The Critch-Tallinn-SFF-BERI web, while managed with recusals, represents structural concentration in the x-risk funding ecosystem that limits independent oversight.
  7. Scalability concerns acknowledged: BERI's own 2024 goals admit "Many of our current processes are simply not scalable... With 37 collaborations and likely more to come, it's critical that we fix this now." No evidence the fix happened.

Cross-References

  • Effective Ventures / CEA: Similar fiscal sponsorship model but much larger and more centralized. BERI is smaller, leaner, and more focused on university contexts. EV's governance failures provide a cautionary tale about concentrated organizational structures.
  • Rethink Priorities Special Projects Program: BERI explicitly refers researchers to RP-SPP for traditional fiscal sponsorship. Different niche -- RP-SPP does general fiscal sponsorship, BERI is university-specific.
  • CHAI (Stuart Russell): BERI's first and most enduring collaboration. CHAI is BERI's largest single program by CG grant volume.
  • MATS: BERI's most successful incubation, now independent. The relationship shows BERI's model at its best.
  • SFF (Survival and Flourishing Fund): Seeded from BERI, now a major funder (~$15M in 2024 Initiative Committee grants alone). Critch sits on both BERI and SFF. The structural interconnection is the most notable cross-reference.
  • Coefficient Giving/Open Phil: Primary funder. CG's continued small-to-medium grants suggest ongoing positive assessment but declining investment relative to the MATS era.

What Would Change This Assessment

Upward updates:

  • BERI publishes a formal theory of change with testable predictions about how their work reduces x-risk
  • Successfully diversifies funding beyond 50% from top two donors
  • Elizabeth Cooper publishes substantive public writing on AI safety strategy
  • Independent evaluation confirms high counterfactual impact of BERI-supported research
  • The "new program" beyond collaborations launches and demonstrates impact

Downward updates:

  • 2025-2026 revenue continues declining, confirming post-MATS contraction
  • Collaborator survey satisfaction drops below 4.0/5.0
  • Evidence emerges that BERI-supported research groups produce less impactful work than non-BERI peers
  • The Critch-Tallinn network faces scrutiny revealing undisclosed conflicts
  • BERI fails to add the independent board member needed to separate ED and Board President roles

Self-Critique

Weakest claim: My assessment of BERI's "revealed theory of change" being partly about incubation is based on just three examples (MATS, SecureBio, SFF). This could be pattern-matching rather than a real strategic function.

Sources I should have checked but could not:

  • EA Forum discussion threads about BERI (blocked domain)
  • LessWrong posts, including Critch's "Taking AI Risk Seriously" (blocked domain)
  • BERI annual reports (hosted on Google Docs, not fetchable)
  • Full Charity Navigator assessment

Potential bias: I may be too sympathetic to BERI's "humble infrastructure" framing. A harder-nosed assessment might conclude that an org with no published theory of change, no impact evaluation, and opaque selection criteria is simply under-managed, not admirably lean. The 44% counterfactual claim from a self-administered survey is not strong evidence by rigorous standards.

What a thoughtful disagreer would say: "BERI is a perfectly fine small nonprofit doing perfectly fine small work. The problem is opportunity cost. The millions of dollars flowing through BERI could be directed more effectively through direct grants to these same research groups. The 10-15% overhead, even if competitive, is a tax on x-risk funding that produces no research. The incubation examples are happy accidents, not a model. And the founder leaving to build a for-profit tells you everything about whether he thinks this model actually works."

Information that would most change my view: An independent evaluation of whether BERI-supported research groups produce more impactful safety research than comparable non-BERI groups. If the answer is no, then BERI provides convenience but not impact. If the answer is yes, then the operational leverage theory of change is validated.

Connected to (16)

MATSspun off fromCenter for Long-Term Cybersecuritycollaborator · Anthony BarrettCentre for the Study of Existential Riskcollaborator · Elizabeth CooperDavid Krueger AI Safety Labcollaborator · David KruegerSurvival and Flourishing Fundspun off from · Andrew CritchCenter for Human-Compatible AIcollaborator · Stuart RussellFuture of Humanity InstitutecollaboratorCenter for Applied Rationalityboard overlap · Andrew CritchFAR AIboard overlap · Sawyer Bernath
SecureBiospun off from · Kevin Esvelt
Tarbell Center for AI Journalismstaff to · Sawyer Bernath
Encultured AIstaff to · Andrew Critch
Oxford China Policy Labcollaborator
Stanford Existential Risks Initiativecollaborator
Machine Intelligence Research Institutestaff from · Andrew Critch
Jane Street Capitalstaff from · Andrew Critch
Sources (33)
Every URL that was read during research.
  1. 1.About — Berkeley Existential Risk Initiativeexistence.org
  2. 2.Team — Berkeley Existential Risk Initiativeexistence.org
  3. 3.Info — Berkeley Existential Risk Initiativeexistence.org
  4. 4.Collaborations — Berkeley Existential Risk Initiativeexistence.org
  5. 5.Transparency — Berkeley Existential Risk Initiativeexistence.org
  6. 6.What does BERI do and why is it important? — Berkeley Existential Risk Initiativeexistence.org
  7. 7.BERI Overhead — Berkeley Existential Risk Initiativeexistence.org
  8. 8.Trial collaborations — Berkeley Existential Risk Initiativeexistence.org
  9. 9.CLTC converted to main collaboration — Berkeley Existential Risk Initiativeexistence.org
  10. 10.Andrew Critch on AI Research Considerations for Human Existential Safety - Future of Life Institutefutureoflife.org
  11. 11.Andrew Critchacritch.com
  12. 12.Berkeley Existential Risk Initiative - Nonprofit Explorer - ProPublicaprojects.propublica.org
  13. 13.Berkeley Existential Risk Initiative donations receiveddonations.vipulnaik.com
  14. 14.Center for Human-Compatible Artificial Intelligence - Wikipediaen.wikipedia.org
  15. 15.Charity Navigator - Rating for Berkeley Existential Risk Initiativecharitynavigator.org
  16. 16.MATS Transparencymatsprogram.org
  17. 17.Unknowntony-barrett.com
  18. 18.AI Risk-Management Standards Profile for General-Purpose AI Systems (GPAIS) and Foundation Models - CLTCcltc.berkeley.edu
  19. 19.Andrew Critch | What AGI might look like in practiceexistentialhope.com
  20. 20.Blog — Berkeley Existential Risk Initiativeexistence.org
  21. 21.Ending collaborations with FHI and Sculpting Evolution — Berkeley Existential Risk Initiativeexistence.org
  22. 22.BERI’s Goals and Predictions for 2024 — Berkeley Existential Risk Initiativeexistence.org
  23. 23.2024 Collaborator Survey Results — Berkeley Existential Risk Initiativeexistence.org
  24. 24.BERI Returns All FTX Funds — Berkeley Existential Risk Initiativeexistence.org
  25. 25.Announcing BERI’s first grants program — Berkeley Existential Risk Initiativeexistence.org
  26. 26.Activity Update - November 2018-March 2019 — Berkeley Existential Risk Initiativeexistence.org
  27. 27.The Center for Applied Rationality (CFAR)acritch.com
  28. 28.Initiative Committee | Survival and Flourishing Fundsurvivalandflourishing.fund
  29. 29.BERI 2022 collaborator survey results — Berkeley Existential Risk Initiativeexistence.org
  30. 30.ARCHES: AI Research Considerations for Human Existential Safetyacritch.com
  31. 31.Encultured AIencultured.ai
  32. 32.Donate — Berkeley Existential Risk Initiativeexistence.org
  33. 33.Sawyer Bernath's Homepagesawyerbernath.com