← AI Safety Orgs

RAND Corporation (Global and Emerging Risks)

Governance

Defense think tank. Compute governance.

Founded
1948
HQ
Santa Monica, CA
Team
1,850
Structure
501(c)(3) nonprofit
Model
Government Contracts

Theory of Change

RAND's AI safety theory of change, articulated by CEO Jason Matheny, rests on a nuclear technology analogy: build governance guardrails for AI comparable to those developed for nuclear weapons, so humanity can "get the benefit and reduce the risk." Matheny describes himself as an "apaco optimist" -- optimistic about humanity's trajectory if existential risks can be navigated -- and identifies AI and synthetic biology as the primary threats.

In his own words: "The only real threat to technological advancement is an apocalyptic catastrophe" (Business for Good podcast, 2023). He recommends Toby Ord's "The Precipice" as the most important book he's read. When asked what research pod he'd run at RAND, he chose "guardrails on AI and synthetic biology, comparable to the guardrails we put on nuclear technologies."

RAND's approach is specifically policy-focused and US-government-facing: produce technical analysis (model weight security, compute governance, AI evaluations, bio-risk assessments), conduct wargaming exercises with senior officials, train the next generation of tech policy analysts, and translate findings into federal regulation. The theory is that RAND's unique position -- trusted by the national security establishment, able to convene classified exercises, operating FFRDCs for DoD/DHS -- gives it policy influence that pure AI safety orgs lack.

What They Do

RAND's AI safety work is housed in the Global and Emerging Risks (GER) division, which contains several distinct centers:

RAND CAST (Center on AI, Security, and Technology): Founded by Sella Nevo. Produced the landmark report on securing AI model weights -- identifying 38 attack vectors and proposing 5 security levels. Lennart Heim led the compute governance team here until his recent departure.

Canary Project ($38M via Audacious Project + $10M from Open Phil): Collaboration with METR to develop AI evaluation methods and test systems for dangerous capabilities. Target: by 2027, enable rigorous safety evaluations for any new AI system before release.

Geopolitics of AGI Center (launched Dec 2023): Runs "Day After AGI" tabletop exercises simulating NSC responses to AI crises. The "Robot Insurgency" scenario tested US readiness for rogue AI cyberattacks with participation from former officials at DoD, State, Treasury, Commerce, and the IC. Conclusion: the US is "unprepared."

Technology and Security Policy Center (TASP): ~100 people, founded by Jeff Alstott. Broader emerging technology policy work, partly funded by Open Phil.

Meselson Center for Biodefense: Directed by Nevo. Biosecurity policy, including AI-bio intersection.

Notable research outputs: RAND's bio-risk red-team study (Jan 2024) found current LLMs do not meaningfully increase biological weapons risk compared to using the internet alone -- a nuanced empirical finding that pushes back against hype. Heim's compute governance work on hardware-enabled mechanisms and the AI Diffusion Framework influenced chip export controls (though the Trump administration rescinded the AI Diffusion Rule in May 2025).

Policy influence: RAND helped draft Section 4 of Biden's AI Executive Order (Oct 2023). RAND spokesperson confirmed involvement. All six policy recommendations from a senior RAND official's congressional testimony appeared in the EO.

Key People

Jason Matheny -- CEO since July 2022. The architect of RAND's AI safety pivot. Career arc: art history BA (Chicago), PhD applied economics (Johns Hopkins), research director at FHI Oxford, founded New Harvest (cultivated meat), directed IARPA, founded CSET Georgetown, Biden White House NSC/OSTP, then RAND CEO. Was an initial trustee of Anthropic's LTBT (stepped down Dec 2023 to preempt conflicts of interest). Deep EA/longtermist ties. Compensation: $1.04M (FY2024).

Sella Nevo -- Founding director of RAND CAST and Meselson Center. Previously founded Google's Karmel humanitarian ML group (70 people). ALLFED board member. Led the model weights security report. Brings genuine technical credibility plus x-risk orientation.

Lennart Heim (departed) -- Formerly led compute governance at RAND CAST. Previously at GovAI Oxford. Now independent researcher. His departure leaves a significant gap in RAND's compute governance portfolio.

Notable connections: Tasha McCauley is an adjunct RAND scientist who was on OpenAI's board (participated in Altman firing, left March 2024) and is an Effective Ventures UK trustee. Jeff Alstott (TASP founding director) worked with Matheny at the White House and has EA ties.

Money and Incentives

Total revenue: $467M (FY2023), $514M (FY2024). RAND is one of the world's largest policy research organizations.

Revenue breakdown: 89% from US federal government contracts. RAND operates 4 FFRDCs for DoD, Air Force, Army, and DHS. FY2024: $328M from federal government, $15.5M from program services, $7.5M from investments. Endowment: $330M. Net assets: $466M.

Business model: Contract research. RAND is paid to answer specific questions from government and foundation clients. 93% of revenue is classified as "contributions" (including government contracts).

Open Philanthropy grants: $65.5M across 13 grants (2014-2025). This is <2% of annual revenue but is strategically concentrated in the GER division. Most grants are explicitly "to be spent at the discretion of RAND president and CEO Jason Matheny." Largest: $16.5M biosecurity (2023), $10.5M emerging tech (2023), $10M Canary AI evaluation (2025), $6M TASP (2024).

Audacious Project: ~$38M for Canary (with METR), Oct 2024.

Defense funding context: Between 2014-2019, RAND received $1.029 billion from defense contractors and government agencies -- 95% of all such funding to the top 50 US think tanks (Center for International Policy data).

Incentive tensions:

  • RAND's primary financial incentive is to serve the US government, which may or may not align with global AI safety priorities.
  • Open Phil grants are small relative to RAND's budget but disproportionately fund the AI safety work. If Open Phil withdrew, the AI safety pivot could contract.
  • The "at Matheny's discretion" grant structure concentrates power and creates an appearance of personal patronage.
  • RAND has financial incentives to support the priorities of whoever funds it -- the same echo chamber critique applied to defense spending applies to EA-aligned spending.
  • If Matheny leaves, the AI safety pivot's survival is uncertain -- it depends heavily on him personally.

What Others Say

Internal dissent: At an October 2023 all-hands meeting, a RAND employee expressed concern that Open Phil ties "might undermine [RAND's] reputation for rigor and objectivity" and worried about prioritizing the "effective altruism agenda" over impartial policy development.

Congressional critique (Sen. Cruz, Sept 2024): "RAND apparently had an outsized role in drafting the AI Executive Order." Cruz lists RAND-Open Phil-Anthropic personnel connections and questions RAND's objectivity. The conflict-of-interest claims are substantive and largely confirmed.

Bipartisan congressional concern (House Science Committee, Dec 2023): Bipartisan letter to NIST warning about "self-referential" AI safety research from RAND and others, lacking "quality that comes from revision in response to critiques by subject matter experts."

Structural critique (Chalmers Johnson, Global Policy): RAND is "America's University of Imperialism." Historical argument that RAND has always served US military hegemony and was "super-cautious about speaking truth to power." The analytical errors in Vietnam and the Cold War stemmed from ideological commitment to American dominance.

Pentagon echo chamber (Inkstick, 2020): RAND received 95% of all defense-think tank funding. Congressional testimonies implicitly recommend more Pentagon spending. "There are enormous financial incentives for RAND to support the Pentagon."

Internal counterpoint (Marek Posard, RAND sociologist): Published commentary arguing philosophical debates about AI risks (EA vs e/acc) are a "distraction" from real AI policy work. Called both perspectives "not particularly helpful" -- "they're assumptions of what a small group thinks the world is."

Community visibility: RAND's AI safety work is essentially invisible on LessWrong and EA Forum (3 posts, all tangential). The AI safety community does not appear to discuss RAND's work substantively.

What's Absent

RAND does not publish data on how much of its $467M+ budget goes to AI safety work versus its dozens of other research areas. No public data exists on GER division headcount or growth trajectory. No external evaluation of RAND's AI safety portfolio exists despite $65.5M+ in Open Phil funding. RAND does not address how its US-national-security framing of AI safety relates to global AI safety priorities. RAND's AI safety work focuses entirely on governance and misuse (model theft, bioweapons, compute controls, evaluations) -- technical alignment is not discussed. No published conflict-of-interest policy specific to the Open Phil funding arrangement has been identified. Lennart Heim's departure occurred without a public explanation. No evidence of coordination with traditional AI safety research orgs (MIRI, ARC, Redwood) beyond the METR/Canary collaboration exists.

Recommended Reading

  1. ChinaTalk: Matheny on RAND's Legacy and Future (Nov 2023) -- Two hours of Matheny speaking candidly about RAND's organizational design, hiring philosophy, and his vision for navigating existential risk. The most unfiltered look at how RAND's CEO actually thinks. Link

  2. Cruz press release and letter (Sept 2024) -- The most detailed critique of RAND's conflicts of interest. Factually substantive on the RAND-Open Phil-Anthropic triangle. Link

  3. 80K Hours: Sella Nevo on AI model weight security (Aug 2024) -- Deep technical conversation revealing RAND CAST's flagship AI security work. The best window into what RAND's AI safety research actually looks like in practice. Link

  4. When RAND Made Magic (Asterisk Magazine, Nov 2024) -- Essential historical context. Why RAND's golden age ended, and whether Matheny's AI safety pivot can succeed within the institution's structural constraints. Link

  5. Inkstick: How Pentagon Spending Perpetuates Pentagon Spending (Oct 2020) -- The structural critique of RAND's incentive environment, documenting $1B+ in defense funding and the echo chamber dynamic. The argument applies equally to EA-funded AI safety work. Link

Connected to (10)

Sources (39)
Every URL that was read during research.
  1. 1.RAND's Matheny on AI, X-Risk, & Bureaucracychinatalk.media
  2. 2.Matheny on RAND’s Legacy and Futurechinatalk.media
  3. 3.Canary: A collaboration between METR and RAND | The Audacious Projectaudaciousproject.org
  4. 4.Lennart Heim on the compute governance era and what has to come after | 80,000 Hours80000hours.org
  5. 5.New Support Through The Audacious Projectmetr.org
  6. 6.RAND Corporation - Wikipediaen.wikipedia.org
  7. 7.Jason Gaverick Matheny - Wikipediaen.wikipedia.org
  8. 8.Jason Matheny | Center for Security and Emerging Technologycset.georgetown.edu
  9. 9.Ella Guest – Horizon Institute for Public Servicehorizonpublicservice.org
  10. 10.Dr. Jason Mathenycnas.org
  11. 11.Lennart Heimheim.xyz
  12. 12.researchheim.xyz
  13. 13.Unknowncommerce.senate.gov
  14. 14.Congressional Concerns Over NIST's AI Research Partnership with RAND Corpentrelligence.com
  15. 15.RAND’s Role in Shaping Biden’s AI Policy Raises Questions About Influence | AI Explained | CryptoRank.iocryptorank.io
  16. 16.Science Committee Leaders Stress Importance of Diligence in NIST AI Safety Research Fundingscience.house.gov
  17. 17.The Long-Term Benefit Trustanthropic.com
  18. 18.How Anthropic Designed Itself to Avoid OpenAI’s Mistakestime.com
  19. 19.RAND Forecasting Initiativerandforecastinginitiative.org
  20. 20.Unknownhsgac.senate.gov
  21. 21.When RAND Made Magic + Jason Matheny Responsechinatalk.media
  22. 22.Science Committee Leaders Stress Importance of Diligence in NIST AI Safety Research Fundingthefederalnewswire.com
  23. 23.Sella Nevo | Homepagesellanevo.com
  24. 24.Sella Nevo | Impactsellanevo.com
  25. 25.ChinaTalk: RAND CEO Jason Matheny Gives a Masterclass on Risk and Organizational Designlawfaremedia.org
  26. 26.Sella Nevo on who's trying to steal frontier AI models, and what they could do with them | 80,000 Hours80000hours.org
  27. 27.On the Geopolitics of AGIgeopoliticsagi.substack.com
  28. 28.The RAND Corporation: America's University of Imperialismarchive.globalpolicy.org
  29. 29.Ep. 111 - From Cultivated Meat to National Security: The Journey of Jason Matheny — Business for Good Podcastbusinessforgoodpodcast.com
  30. 30.America’s Think Tankcjr.org
  31. 31.Rand Corporation - Nonprofit Explorer - ProPublicaprojects.propublica.org
  32. 32.RAND Corporation | Nonprofit Organization, Policy Analysis, Research | Britannicabritannica.com
  33. 33.Update on the Horizon Institute for Public Service – Horizon Institute for Public Servicehorizonpublicservice.org
  34. 34.Could AI help bioterrorists unleash a new pandemic? A new study suggests not yetthebulletin.org
  35. 35.How Pentagon Spending Perpetuates Pentagon Spending | Inkstickinkstickmedia.com
  36. 36.RAND Simulates a 'Robot Insurgency' to Test U.S. Readiness -- It Goes About as Well as You Might Expecttheaiinsider.tech
  37. 37.Sen. Cruz Sounds Alarm Over Industry Role in AI Czar Harris’s Censorship Agendacommerce.senate.gov
  38. 38.RAND Corp. Behind Biden's AI Executive Ordernewsmax.com
  39. 39.Anthropic Long-Term Benefit Trustcorpgov.law.harvard.edu