← AI Safety Orgs

Center for Applied Rationality (CFAR)

Field-Building

Rationality → safety pipeline. Historical.

Founded
2012
HQ
Berkeley, CA
Team
7
Structure
501(c)(3) nonprofit
Model
Donations

Theory of Change

CFAR has had three distinct theories of change:

2012-2020 (original): Train people in rationality techniques derived from LessWrong/Sequences. Some would recognize AI risk and work on safety. The explicit function was talent pipeline -- Open Philanthropy's grant descriptions state: "Our primary interest in these workshops is that we believe they introduce people to and/or strengthen their connections with the effective altruism community and way of thinking." Anna Salamon later admitted: "I was scared about AI risk, all the time... my notion of which participants were the coolest was mostly: who might do good work re: AI safety."

2018-2020 (pivot): Explicitly focused on AI safety recruiting, running AI-specific programs (MIRI Summer Fellows, AIRCS, CML). Impact was measured by alumni working at MIRI, DeepMind safety, CHAI, or EA orgs. Then CFAR went into hibernation from 2020-2024.

2025-present (relaunch as "aCFAR"): Salamon: "We are not backchained from 'help get the world into state X which'll be better for AI,' nor from 'help recruit people to AI safety work.'" The new model is a community of people geeking out about rationality questions, with no claimed long-term EA payoff. "If we can't make a financial go of things under our new ethos, my plan is not to revert to our past ethos, it's to fold."

What They Do

CFAR runs 4.5-day immersive workshops with ~25 participants. Curriculum includes Double Crux, TAPs (Trigger-Action Plans), Inner Simulator, Bug Lists, and new "honoring who-ness" content. They ran ~60 workshops from 2012-2020 with ~1,900 total guests, then went dormant for 5 years. Workshops resumed in 2025 with a new part-time instructor model.

Impact data (2017, most recent available): Of 894 alumni, 159 had a measurable "increase in expected impact" -- 19 at EA/AI orgs, 15 at MIRI, 28 on AI safety career paths, 32 through donations. AI-specific programs had ~3.3x the impact of mainline workshops, primarily through MIRI recruiting.

CFAR also fiscally sponsored LessWrong/Lightcone Infrastructure (2017-2024, now independent) and SPARC (ongoing youth program). SPARC has continued to receive Open Phil funding ($700K in 2022) even after CFAR lost general support.

Key People

Anna Salamon -- President and sole remaining active cofounder. Left philosophy PhD in 2008 for AI risk work. The organizational constant across all eras. Authored the most candid self-critique of any AI safety org leader, admitting CFAR's workshops were shaped more by AI risk fear than genuine rationality development. Told NBC News (Feb 2025): "in hindsight we were creating conditions for a cult."

All three other cofounders departed: Julia Galef (~2016, founded Update Project, wrote "The Scout Mindset"), Andrew Critch (cofounded BERI, SFF, now CEO of Encultured AI), Michael Smith (departed). Current team is ~7 part-time curriculum developers with no full-time staff. Duncan Sabien, former Curriculum Director and handbook author, publicly opposed the 2025 relaunch.

Money and Incentives

CRITICAL: CFAR's 990 data is misleading. The 990s show $9.1M revenue (2023) and $11.6M (2022), but this is almost entirely Lightcone Infrastructure pass-through money. CFAR's own operations were ~$1.5-2.5M/year pre-2020. Total liabilities of $23.6M (2023) reflect fiscal sponsorship obligations, not CFAR's debts.

CFAR's actual operating budget (2019): ~$1.5M total. 84% from grants (Open Phil, BERI, LTFF, SFF), 16% workshop revenue.

Current state (Dec 2025): $129K available, ~4 months runway. Seeking $125K-$200K to survive through 2026. Annual costs ~$300K+ (admin $72K, venue net ~$50K, workshops net loss ~$130K, curriculum $25K). Workshops lose money -- November 2025 workshop was -$28,400 net.

Major funding sources (historical):

  • Coefficient Giving/Open Phil: $4.3M total (2016-2022). General support ended with 2020 "exit grant." Last grant was for SPARC only.
  • SFF (Jaan Tallinn, cofounded by Andrew Critch): ~$2.2M directly to CFAR (2019-2024)
  • BERI (cofounded by Andrew Critch): ~$1.1M (2018)
  • FTX: ~$4.9M (2022, for Lightcone -- now subject to clawback lawsuit)
  • Workshop revenue: Always a small fraction (~$25K-$160K/year for CFAR's own programs)

Key financial dynamics:

  • Open Phil's decision to exit in 2020 is a strong negative signal from a sophisticated evaluator
  • CFAR is deliberately rejecting its old EA-donor funding model without a proven replacement
  • The FTX clawback lawsuit ($4.9M) is existentially threatening for an org with $129K in cash
  • The Bodega Bay venue is both CFAR's main asset and a significant ongoing cost (~$285K/year, offset by ~$200K rental income)
  • Andrew Critch cofounded both BERI and SFF, two of CFAR's major funders, creating a tight funding circle

What Others Say

Strongest critical argument: CFAR's theory of change was always circular -- it attracted people already interested in rationality/EA, trained them in techniques that were never rigorously validated, claimed credit when they went on to do AI safety work they were already inclined toward, and created a psychologically intense community that enabled several serious harms (Brent Dill's abuse, Zizian radicalization, mental health crises). Anna Salamon herself provides the strongest version of this critique: CFAR optimized for "does this cause people to look like people who will help with AI risk" rather than "are they making real research progress now."

Jessica Taylor (former MIRI researcher, 2021): Described psychotic breaks, at least 4 psychiatric hospitalizations in the MIRI/CFAR social circle, 2 suicides (Maia Pasek and Jay Winterford), and called CFAR "pretty corrupt." She wrote: "Most of what was considered bad about Leverage Research also happened around MIRI/CFAR."

Asterisk Magazine (2025): "The Sequences create the raw material for a cult." CFAR "occasionally blurred the line between rationality curriculum development, people management, and therapy." A Harvard chaplain asked: "How much more cult-like does it have to get?"

Zvi Mowshowitz (2017, pre-crisis): "CFAR does excellent and important work." Donated $4,000. But presciently warned about Goodhart's Law: measuring impact through EA/AI outcomes could distort workshops toward persuasion over genuine rationality development.

Oliver Habryka (Lightcone, formerly under CFAR, 2023): Expressed doubts about whether the entire EA/rationality ecosystem was net positive, questioning whether it had accelerated AI timelines through founding DeepMind, OpenAI, and Anthropic.

Rolling Stone, NBC, Guardian: Extensive investigative journalism covering the Zizian deaths (6 linked), FTX financial connections, and Manifest conference controversies. These have permanently shaped public perception of the rationalist community.

What's Absent

  • No rigorous external evaluation of workshop effectiveness after 13 years (no RCTs, no control groups, only self-report data from 2015/2017)
  • No public accounting of CFAR operations budget separate from Lightcone pass-through for 2021-2023
  • No published safety policies for the 2025 relaunch despite the Brent Dill affair and community mental health history
  • No systematic tracking of negative outcomes (mental health crises, disillusioned alumni)
  • No response to the FTX clawback lawsuit publicly
  • No alumni tracking data since 2017 (8 years, ~1,000 additional alumni)
  • No comparison with modern field-building alternatives (MATS, BlueDot, ARENA)

Recommended Reading

  1. Anna Salamon's "why CFAR didn't get farther with a real art of rationality" (June 2022, LessWrong) -- The founder's rigorous self-critique. She explains how AI risk fear corrupted CFAR's curriculum development, how "internal double crux" worked as persuasion rather than truth-finding, and why the rationality project hit the same walls as every self-help movement. The most honest assessment of what went wrong.

  2. Jessica Taylor: "My experience at and around MIRI and CFAR" (2021, LessWrong) -- Critical insider testimony. Psychotic breaks, hospitalizations, suicides, power dynamics, secrecy culture. The strongest case that CFAR/MIRI's community caused real harm.

  3. Anna Salamon's Dec 2025 fundraiser post (LessWrong) -- 11,000 words of radical transparency about CFAR's failures, the new vision, and her personal journey. Read this to understand what the relaunch is trying to be.

  4. Asterisk: "Why Are There So Many Rationalist Cults?" (August 2025) -- Best analytical piece on why the rationalist community spawns dysfunctional groups. Distinguishes between cult dynamics (Leverage, Zizians, Black Lotus) and more functional rationalist institutions, identifying the common failure modes.

  5. Rolling Stone: "The Radicalization of Ziz Lasota" (December 2025) -- How an AI safety advocate became linked to 6 deaths. Essential context for understanding CFAR's most serious controversy and the broader risks of intense ideological communities.

Connected to (8)

Encultured AIstaff to · Andrew Critch
FABRICcollaborator · Jan Kulveit
Survival and Flourishing Fundboard overlap · Andrew Critch
Berkeley Existential Risk Initiativeboard overlap · Andrew Critch
Lightcone Infrastructurecollaborator · Oliver Habryka
Update Projectstaff to · Julia Galef
SPARCcollaborator
Machine Intelligence Research Institutespun off from · Anna Salamon
Sources (79)
Every URL that was read during research.
  1. 1.Center for Applied Rationality - Wikipediaen.wikipedia.org
  2. 2.Missionrationality.org
  3. 3.Homerationality.org
  4. 4.Updatesrationality.org
  5. 5.CFAR 2017 Impact Reportrationality.org
  6. 6.CFAR's Mistakes Regarding Brentrationality.org
  7. 7.Techies Spending $4K A Pop On 'Rationality' Seminars That Sound Vaguely Culty: SFistsfist.com
  8. 8.CFAR 2017 Fundraiserrationality.org
  9. 9.CFAR 2017 Retrospectiverationality.org
  10. 10.ACDC Update and Apologyrationality.org
  11. 11.Further Updatesrationality.org
  12. 12.CFAR Newsletter (May 2019)rationality.org
  13. 13.CFAR Newsletter (August 2018)rationality.org
  14. 14.The Center for Applied Rationality (CFAR)acritch.com
  15. 15.Summer Program | SPARCsparc.camp
  16. 16.My experience at and around MIRI and CFAR (inspired by Zoe Curzi's writeup of experiences at Leverage)greaterwrong.com
  17. 17.6 Deaths, 3 States and the Radical Breakaway 'Rationalists' at the Center of the Nightmarerollingstone.com
  18. 18.What is Going On With CFAR?greaterwrong.com
  19. 19.What’s going on at CFAR? (Updates and Fundraiser)greaterwrong.com
  20. 20.CFAR’s new focus, and AI Safetygreaterwrong.com
  21. 21.Further discussion of CFAR’s focus on AI safety, and the good things folks wanted from “cause neutrality”greaterwrong.com
  22. 22.The Story CFARgreaterwrong.com
  23. 23.Double Crux — A Strategy for Resolving Disagreementrationality.org
  24. 24.Workshop FAQrationality.org
  25. 25.CFAR Handbookrationality.org
  26. 26.Rationality-Related Writing by Current and Former CFAR Staffrationality.org
  27. 27.Updates Archiverationality.org
  28. 28.My experience of the 2025 CFAR Workshopgreaterwrong.com
  29. 29.CFAR update, and New CFAR workshopsgreaterwrong.com
  30. 30.More details on CFAR’s new workshopsgreaterwrong.com
  31. 31.ClearerThinking.org Podcast | Lines of Retreat and Incomplete Maps (with Anna Salamon)podcast.clearerthinking.org
  32. 32.June 2025 Experimental Mini-Workshoprationality.org
  33. 33.CFAR workshop reviewbenkuhn.net
  34. 34.Financial Overview: 2018-2020rationality.org
  35. 35.2022 Form 990 for Center for Applied Rationality (CFAR)causeiq.com
  36. 36.Sponsored Projectsrationality.org
  37. 37.FAQ — European Summer Program in Rationalityespr.camp
  38. 38.FAQ — PAIR: Program on AI and Reasoningpair.camp
  39. 39.FAQ — ASPRaspr.camp
  40. 40.The LessWrong Team is now Lightcone Infrastructure, come work with us!greaterwrong.com
  41. 41.Lightcone Infrastructure/LessWrong is looking for fundinggreaterwrong.com
  42. 42.[Linkpost] Guardian article covering Lightcone Infrastructure, Manifest and CFAR ties to FTXgreaterwrong.com
  43. 43.FTX chasing $5M spent on ‘right-wing’ conference venueprotos.com
  44. 44.Sam Bankman-Fried funded a group with racist ties. FTX wants its $5m backtheguardian.com
  45. 45.Shutting Down the Lightcone Officesgreaterwrong.com
  46. 46.Transcript for Geoff Anders and Anna Salamon's Oct. 23 conversationgreaterwrong.com
  47. 47.Carrying the Torch: A Response to Anna Salamon by the Guild of the Rosegreaterwrong.com
  48. 48.Applied Rationality Workshopsrationality.org
  49. 49.Why CFAR? The view from 2015greaterwrong.com
  50. 50.CFAR: Progress Report & Future Plansgreaterwrong.com
  51. 51.CFAR in 2014: Continuing to climb out of the startup pit, heading toward a full prototypegreaterwrong.com
  52. 52.The 'Rationality' Workshop That Teaches People to Think More Like Computersvice.com
  53. 53.Retrospective on Teaching Rationality Workshopsgreaterwrong.com
  54. 54.Comment reply: my low-quality thoughts on why CFAR didn't get farther with a "real/efficacious art of rationality"greaterwrong.com
  55. 55.Review and Thoughts on Current Version of CFAR Workshopgreaterwrong.com
  56. 56.No standard metric for CFAR workshops?greaterwrong.com
  57. 57.Why Are There So Many Rationalist Cults?asteriskmag.com
  58. 58.THE RATIONALITY TRAPaipanic.news
  59. 59.How did a German math genius get drawn into a 'cult' accused in coast-to-coast killings?nbcnews.com
  60. 60.The Radicalization of Ziz Lasota: How an AI Doomer Became an Accused Cult Leaderrollingstone.com
  61. 61.Lighthaven | Retreats, Conferences, and Event Space in Berkeleylighthaven.space
  62. 62.AI Safety Advocate Linked to Multiple Murdersfuturism.com
  63. 63.CFAR Staffrationality.org
  64. 64.This century is critical for humanity. We build tech, infrastructure, and community to navigate it.lightconeinfrastructure.com
  65. 65.Recommendations | Survival and Flourishing Fundsurvivalandflourishing.fund
  66. 66.Lightcone Foundation - Nonprofit Explorer - ProPublicaprojects.propublica.org
  67. 67.Lightcone Infrastructure Inc - Nonprofit Explorer - ProPublicaprojects.propublica.org
  68. 68.Center for Applied Rationality | Berkeley, CA | 990 Report | Instrumentlinstrumentl.com
  69. 69.PAIR: Program on AI and Reasoningpair.camp
  70. 70.Team — PAIR: Program on AI and Reasoningpair.camp
  71. 71.European Summer Program in Rationalityespr.camp
  72. 72.ASPRaspr.camp
  73. 73.CFAR Newsletter (August 2019)rationality.org
  74. 74.CFAR Newsletter (January 2019)rationality.org
  75. 75.Zizians - Wikipediaen.wikipedia.org
  76. 76.We run the Center for Applied Rationality, AMAgreaterwrong.com
  77. 77.Layers and layers of griftingfreethoughtblogs.com
  78. 78.The rationalist murdersnewhumanist.org.uk
  79. 79.CFAR Newsletter (December 2019)rationality.org