← AI Safety Orgs

RAND Corporation (Global and Emerging Risks)

Governance

Defense think tank. Compute governance.

Founded
1948
HQ
Santa Monica, CA
Team
1,850
Structure
501(c)(3) nonprofit
Model
Government Contracts

Theory of Change

RAND's AI safety theory of change, articulated by CEO Jason Matheny, rests on a nuclear technology analogy: build governance guardrails for AI comparable to those developed for nuclear weapons, so humanity can "get the benefit and reduce the risk." Matheny describes himself as an "apaco optimist" -- optimistic about humanity's trajectory if existential risks can be navigated -- and identifies AI and synthetic biology as the primary threats.

In his own words: "The only real threat to technological advancement is an apocalyptic catastrophe" (Business for Good podcast, 2023). He recommends Toby Ord's "The Precipice" as the most important book he's read. When asked what research pod he'd run at RAND, he chose "guardrails on AI and synthetic biology, comparable to the guardrails we put on nuclear technologies."

RAND's approach is specifically policy-focused and US-government-facing: produce technical analysis (model weight security, compute governance, AI evaluations, bio-risk assessments), conduct wargaming exercises with senior officials, train the next generation of tech policy analysts, and translate findings into federal regulation. The theory is that RAND's unique position -- trusted by the national security establishment, able to convene classified exercises, operating FFRDCs for DoD/DHS -- gives it policy influence that pure AI safety orgs lack.

What They Do

RAND's AI safety work is housed in the Global and Emerging Risks (GER) division, which contains several distinct centers:

RAND CAST (Center on AI, Security, and Technology): Founded by Sella Nevo. Produced the landmark report on securing AI model weights -- identifying 38 attack vectors and proposing 5 security levels. Lennart Heim led the compute governance team here until his recent departure.

Canary Project ($38M via Audacious Project + $10M from Open Phil): Collaboration with METR to develop AI evaluation methods and test systems for dangerous capabilities. Target: by 2027, enable rigorous safety evaluations for any new AI system before release.

Geopolitics of AGI Center (launched Dec 2023): Runs "Day After AGI" tabletop exercises simulating NSC responses to AI crises. The "Robot Insurgency" scenario tested US readiness for rogue AI cyberattacks with participation from former officials at DoD, State, Treasury, Commerce, and the IC. Conclusion: the US is "unprepared."

Technology and Security Policy Center (TASP): ~100 people, founded by Jeff Alstott. Broader emerging technology policy work, partly funded by Open Phil.

Meselson Center for Biodefense: Directed by Nevo. Biosecurity policy, including AI-bio intersection.

Notable research outputs: RAND's bio-risk red-team study (Jan 2024) found current LLMs do not meaningfully increase biological weapons risk compared to using the internet alone -- a nuanced empirical finding that pushes back against hype. Heim's compute governance work on hardware-enabled mechanisms and the AI Diffusion Framework influenced chip export controls (though the Trump administration rescinded the AI Diffusion Rule in May 2025).

Policy influence: RAND helped draft Section 4 of Biden's AI Executive Order (Oct 2023). RAND spokesperson confirmed involvement. All six policy recommendations from a senior RAND official's congressional testimony appeared in the EO.

Key People

Jason Matheny -- CEO since July 2022. The architect of RAND's AI safety pivot. Career arc: art history BA (Chicago), PhD applied economics (Johns Hopkins), research director at FHI Oxford, founded New Harvest (cultivated meat), directed IARPA, founded CSET Georgetown, Biden White House NSC/OSTP, then RAND CEO. Was an initial trustee of Anthropic's LTBT (stepped down Dec 2023 to preempt conflicts of interest). Deep EA/longtermist ties. Compensation: $1.04M (FY2024).

Sella Nevo -- Founding director of RAND CAST and Meselson Center. Previously founded Google's Karmel humanitarian ML group (70 people). ALLFED board member. Led the model weights security report. Brings genuine technical credibility plus x-risk orientation.

Lennart Heim (departed) -- Formerly led compute governance at RAND CAST. Previously at GovAI Oxford. Now independent researcher. His departure leaves a significant gap in RAND's compute governance portfolio.

Notable connections: Tasha McCauley is an adjunct RAND scientist who was on OpenAI's board (participated in Altman firing, left March 2024) and is an Effective Ventures UK trustee. Jeff Alstott (TASP founding director) worked with Matheny at the White House and has EA ties.

Money and Incentives

Total revenue: $467M (FY2023), $514M (FY2024). RAND is one of the world's largest policy research organizations.

Revenue breakdown: 89% from US federal government contracts. RAND operates 4 FFRDCs for DoD, Air Force, Army, and DHS. FY2024: $328M from federal government, $15.5M from program services, $7.5M from investments. Endowment: $330M. Net assets: $466M.

Business model: Contract research. RAND is paid to answer specific questions from government and foundation clients. 93% of revenue is classified as "contributions" (including government contracts).

Open Philanthropy grants: $65.5M across 13 grants (2014-2025). This is <2% of annual revenue but is strategically concentrated in the GER division. Most grants are explicitly "to be spent at the discretion of RAND president and CEO Jason Matheny." Largest: $16.5M biosecurity (2023), $10.5M emerging tech (2023), $10M Canary AI evaluation (2025), $6M TASP (2024).

Audacious Project: ~$38M for Canary (with METR), Oct 2024.

Defense funding context: Between 2014-2019, RAND received $1.029 billion from defense contractors and government agencies -- 95% of all such funding to the top 50 US think tanks (Center for International Policy data).

Incentive tensions:

  • RAND's primary financial incentive is to serve the US government, which may or may not align with global AI safety priorities.
  • Open Phil grants are small relative to RAND's budget but disproportionately fund the AI safety work. If Open Phil withdrew, the AI safety pivot could contract.
  • The "at Matheny's discretion" grant structure concentrates power and creates an appearance of personal patronage.
  • RAND has financial incentives to support the priorities of whoever funds it -- the same echo chamber critique applied to defense spending applies to EA-aligned spending.
  • If Matheny leaves, the AI safety pivot's survival is uncertain -- it depends heavily on him personally.

What Others Say

Internal dissent: At an October 2023 all-hands meeting, a RAND employee expressed concern that Open Phil ties "might undermine [RAND's] reputation for rigor and objectivity" and worried about prioritizing the "effective altruism agenda" over impartial policy development.

Conservative critique (Sen. Cruz, Sept 2024): "RAND apparently had an outsized role in drafting the AI Executive Order." Cruz lists RAND-Open Phil-Anthropic personnel connections and questions RAND's objectivity. Partisan framing (anti-Harris, anti-censorship, pro-deregulation) but the factual conflict-of-interest claims are substantive and largely confirmed.

Bipartisan congressional concern (House Science Committee, Dec 2023): Bipartisan letter to NIST warning about "self-referential" AI safety research from RAND and others, lacking "quality that comes from revision in response to critiques by subject matter experts."

Left-wing structural critique (Chalmers Johnson, Global Policy): RAND is "America's University of Imperialism." Historical argument that RAND has always served US military hegemony and was "super-cautious about speaking truth to power." The analytical errors in Vietnam and the Cold War stemmed from ideological commitment to American dominance.

Pentagon echo chamber (Inkstick, 2020): RAND received 95% of all defense-think tank funding. Congressional testimonies implicitly recommend more Pentagon spending. "There are enormous financial incentives for RAND to support the Pentagon."

Internal counterpoint (Marek Posard, RAND sociologist): Published commentary arguing philosophical debates about AI risks (EA vs e/acc) are a "distraction" from real AI policy work. Called both perspectives "not particularly helpful" -- "they're assumptions of what a small group thinks the world is."

Community visibility: RAND's AI safety work is essentially invisible on LessWrong and EA Forum (3 posts, all tangential). The AI safety community does not appear to discuss RAND's work substantively.

What's Absent

RAND does not publish data on how much of its $467M+ budget goes to AI safety work versus its dozens of other research areas. No public data exists on GER division headcount or growth trajectory. No external evaluation of RAND's AI safety portfolio exists despite $65.5M+ in Open Phil funding. RAND does not address how its US-national-security framing of AI safety relates to global AI safety priorities. RAND's AI safety work focuses entirely on governance and misuse (model theft, bioweapons, compute controls, evaluations) -- technical alignment is not discussed. No published conflict-of-interest policy specific to the Open Phil funding arrangement has been identified. Lennart Heim's departure occurred without a public explanation. No evidence of coordination with traditional AI safety research orgs (MIRI, ARC, Redwood) beyond the METR/Canary collaboration exists.

Recommended Reading

  1. ChinaTalk: Matheny on RAND's Legacy and Future (Nov 2023) -- Two hours of Matheny speaking candidly about RAND's organizational design, hiring philosophy, and his vision for navigating existential risk. The most unfiltered look at how RAND's CEO actually thinks. Link

  2. Cruz press release and letter (Sept 2024) -- The most detailed critique of RAND's conflicts of interest. Partisan framing but factually substantive on the RAND-Open Phil-Anthropic triangle. Link

  3. 80K Hours: Sella Nevo on AI model weight security (Aug 2024) -- Deep technical conversation revealing RAND CAST's flagship AI security work. The best window into what RAND's AI safety research actually looks like in practice. Link

  4. When RAND Made Magic (Asterisk Magazine, Nov 2024) -- Essential historical context. Why RAND's golden age ended, and whether Matheny's AI safety pivot can succeed within the institution's structural constraints. Link

  5. Inkstick: How Pentagon Spending Perpetuates Pentagon Spending (Oct 2020) -- The structural critique of RAND's incentive environment, documenting $1B+ in defense funding and the echo chamber dynamic. The argument applies equally to EA-funded AI safety work. Link

Show Claude’s analysis
An opinionated read. Read the brief first to form your own view.

Stated Theory of Change

RAND's stated AI safety theory of change is a nuclear technology analogy: develop governance guardrails for AI comparable to those built for nuclear weapons, enabling humanity to "get the benefit and reduce the risk." The mechanism runs through RAND's unique institutional position:

  1. Produce rigorous, nonpartisan analysis of AI risks (model weight security, compute governance, biological misuse, dangerous capabilities)
  2. Convene senior policymakers in classified wargaming exercises (Day After AGI) to surface capability gaps
  3. Shape federal regulation by providing analytical foundations for executive orders, NIST standards, and legislation
  4. Train the next generation of tech policy analysts via fellowships and the RAND School
  5. Evaluate frontier AI systems through the Canary project (with METR) before public release

The implicit claim is that RAND's 78-year institutional credibility, government trust, FFRDC access, and ability to work at classified levels give it policy leverage that pure AI safety organizations cannot match.

Revealed Theory of Change

RAND's actions largely match its stated theory, but with several meaningful divergences:

What actions reveal:

  • The AI safety pivot is disproportionately driven by one person (Matheny) and one funder (Open Phil). Most Open Phil grants are "at Matheny's discretion." If either actor departed, the pivot could reverse.
  • AI safety is a small initiative within a massive defense institution. RAND produces ~1,000 reports per year across dozens of policy areas. The AI safety fraction is unknown but likely small.
  • The work focuses on misuse prevention and governance (model theft, bioweapons, compute controls, evaluations), not technical alignment. This is a deliberate scope choice reflecting RAND's institutional capabilities.
  • RAND's AI safety framing is consistently US-national-security-centric. The Geopolitics of AGI Initiative asks "How should the US government respond?" not "How should humanity respond?"
  • RAND has hired from the EA/AI safety community (Heim from GovAI, Nevo from Google, fellows via Horizon/Open Phil pipeline) but does not appear to coordinate with traditional AI safety research orgs beyond the METR collaboration.

Where actions diverge from stated theory:

  • RAND claims nonpartisan objectivity, but its AI safety work is funded by a small number of EA-aligned sources and staffed by people with EA ties, producing research aligned with EA priorities. This doesn't mean the research is wrong, but it complicates the "nonpartisan" claim.
  • Matheny sat on Anthropic's LTBT while RAND was being funded by Anthropic's largest backer (Open Phil) and while RAND personnel were drafting regulations affecting Anthropic. He only stepped down after the conflict was publicly exposed.
  • RAND's bio-risk study (LLMs don't help with bioweapons) is genuinely independent-minded -- it pushes back against EA/AI safety community consensus. This is evidence that the nonpartisan instinct still functions.

Key Assumptions

Assumption 1: US national security and global AI safety are aligned.

  • Evidence for: Many x-risks (bioweapons, rogue AI, compute proliferation) genuinely threaten the US and the world simultaneously. US policy leadership could set global norms.
  • Evidence against: US-China AI competition could lead to "safety race to the bottom." Export controls may accelerate Chinese domestic chip development. US-centric framing excludes global coordination scenarios.
  • Testable: Yes -- does US AI regulation actually reduce global risk, or does it just shift capability development to less safety-conscious actors?
  • If wrong: RAND's entire approach could produce governance that protects US interests but increases global risk.

Assumption 2: Policy interventions are the most impactful lever for AI safety.

  • Evidence for: Compute governance is genuinely tractable (chips are detectable, excludable, quantifiable). Evaluations could catch dangerous capabilities before deployment. RAND's wargaming reveals real preparedness gaps.
  • Evidence against: Policy is fragile to political shifts (Biden AI Diffusion Rule rescinded by Trump). Regulation follows capability, not the reverse. Technical alignment may matter more than governance if AI systems become genuinely autonomous.
  • Testable: Partially -- the durability of RAND's policy contributions across administrations is already being tested.
  • If wrong: RAND's entire portfolio is second-order -- necessary but insufficient without complementary technical safety work.

Assumption 3: RAND's institutional credibility transfers to AI safety topics.

  • Evidence for: RAND can convene government officials that no AI safety org can. The Day After AGI exercises involved senior DoD/State/IC personnel. RAND's analysis shaped the Biden EO.
  • Evidence against: The EA controversy has damaged credibility with some policymakers. Congressional scrutiny of RAND-Open Phil ties suggests trust erosion. Under a Trump-style administration, RAND's Biden-era AI safety work may be viewed as partisan.
  • Testable: Yes -- does the next administration use RAND's AI safety analysis?
  • If wrong: RAND's policy influence is administration-dependent, not institutional.

Assumption 4: Open Phil funding doesn't compromise RAND's objectivity.

  • Evidence for: RAND's bio-risk study contradicted some EA/AI safety community claims. Open Phil grants are <2% of RAND's total revenue. RAND's transparency about funding is above average for think tanks.
  • Evidence against: Internal employee concern about EA agenda. "At Matheny's discretion" grant structure. Personnel overlap with Anthropic/OpenAI governance. The grants fund the specific work they're meant to influence.
  • Testable: Difficult -- would RAND produce the same analysis if Open Phil funding disappeared?
  • If wrong: RAND's AI safety research carries an institutional bias toward EA priorities.

Strengths

  1. Unique convening power. No other AI safety organization can run classified wargaming exercises with former NSC principals. The Day After AGI exercises surface real preparedness gaps that no amount of academic analysis can identify.

  2. Scale and institutional depth. 1,850 employees, $467M revenue, 78-year reputation. RAND can absorb political attacks that would destroy smaller organizations. The AI safety work benefits from being embedded in a large, diversified institution.

  3. Technical credibility in security domains. The model weights report (38 attack vectors, 5 security levels) demonstrates serious security expertise. The bio-risk red-team study shows willingness to publish nuanced findings that contradict hype.

  4. Policy translation capacity. RAND can translate AI safety concepts into the language of national security policy. Compute governance, model evaluations, and wargaming are policy-relevant outputs, not just academic papers.

  5. Matheny's personal network. FHI, IARPA, CSET, White House, National Security Commission on AI -- Matheny has a unique network spanning the AI safety community and the national security establishment.

Weaknesses and Risks

  1. Single-point-of-failure in Matheny. The AI safety pivot is driven by one CEO who controls most of the EA-aligned funding. Board composition (national security establishment, no AI safety expertise) suggests limited institutional commitment independent of the CEO.

  2. Structural conflicts of interest. The RAND-Open Phil-Anthropic triangle is a genuine problem. Matheny's LTBT membership while RAND was shaping regulation affecting Anthropic, McCauley's dual RAND-OpenAI role, and the "at discretion" grant structure all undermine the nonpartisan claim that is RAND's core institutional asset.

  3. National security tunnel vision. AI safety framed entirely through US national security may miss or worsen global coordination problems. RAND's institutional DNA favors the US perspective, which may be insufficient for a global risk.

  4. No technical alignment work. RAND's portfolio covers governance and misuse but not technical alignment. If AI risk comes primarily from alignment failure rather than misuse, RAND's contributions are peripheral.

  5. Political fragility. The Biden AI EO was closely associated with RAND. Under a different administration, this association is a liability. The Trump admin already rescinded RAND-influenced export controls. Policy work that doesn't survive political transitions has limited long-term value.

  6. AI safety as a small island in a defense ocean. AI safety is a tiny fraction of RAND's work. The institution's primary incentive is to serve the federal government on defense, education, health, and dozens of other topics. AI safety could be deprioritized without affecting RAND's core business.

  7. Lennart Heim departure. The loss of RAND's compute governance lead, without a public successor announcement, raises questions about the sustainability of this research line.

Cross-References

Complements: METR (joint Canary project for AI evaluations), CSET Georgetown (Matheny's prior org, similar tech policy focus), GovAI Oxford (Heim's prior org, compute governance overlap).

Overlaps with: Centre for the Governance of AI (compute governance), CSET (emerging technology policy), Center for AI Safety (evaluations), UK AISI (model evaluations).

Distinct from: MIRI/ARC (technical alignment -- RAND doesn't do this), Anthropic/OpenAI safety teams (lab-internal safety research), PauseAI (activist advocacy).

Tension with: RAND's defense establishment position may conflict with organizations advocating for international AI governance (which could constrain US capabilities). RAND's national security frame implicitly treats AI safety as a US competitive advantage issue.

What Would Change This Assessment

  • Evidence that GER division budget exceeds $50M annually: Would indicate substantive institutional commitment beyond Matheny's personal project.
  • RAND producing AI safety analysis that contradicts Open Phil priorities: Would demonstrate genuine independence. The bio-risk study partially does this.
  • Matheny departure and AI safety work continuing: Would demonstrate institutional commitment beyond one person.
  • RAND publishing work on international AI governance that constrains US capabilities: Would demonstrate willingness to prioritize global safety over US interests.
  • AI safety community engagement with RAND's work on LW/EA Forum: Would indicate RAND's analysis is taken seriously by the broader community.
  • A post-Trump administration adopting RAND's AI governance framework: Would demonstrate durability of RAND's policy contributions.

Self-Critique

Weakest claim: My assessment of RAND's AI safety work as "a small island in a defense ocean" may understate the impact of Matheny's leadership. A visionary CEO can redirect a large institution in ways that are not proportional to budget allocation. The Open Phil funding, though small relative to RAND's total, may have catalytic effects that create much larger shifts in RAND's research agenda.

Potential bias: This analysis may be overly influenced by the conflict-of-interest narrative, which is well-documented but may not accurately predict research quality. RAND researchers may produce genuinely excellent work regardless of funding source, just as academic researchers produce important work despite being funded by interested parties.

Missing sources: I could not access rand.org (blocked), the Politico article (paywalled), or Matheny's Senate testimony (binary PDF). RAND's own descriptions of its AI safety work, research output lists, and staff pages are all missing from the evidence. The analysis is therefore biased toward external perceptions of RAND rather than RAND's own articulation.

What a thoughtful disagreer would say: "RAND is uniquely positioned to bring AI safety into the national security mainstream. The EA funding is a feature, not a bug -- it allows RAND to work on long-term risks that short-term government contracts won't fund. The conflicts of interest are manageable and RAND's bio-risk study proves the research can be independent. Dismissing RAND's AI safety work because it's 'only' a fraction of a $467M institution misses the point -- that fraction has access to policymakers no one else can reach."

Single weakest claim: That RAND's AI safety work is heavily dependent on Matheny personally. This may underestimate the degree to which the GER division has developed its own institutional momentum, hiring, and culture independent of the CEO.

What would most change my view: Seeing quantitative data on GER division headcount, budget, and growth over time. If the division is 200+ people and growing fast with dedicated institutional budget lines, the "small island" critique weakens substantially.

Connected to (10)

Sources (39)
Every URL that was read during research.
  1. 1.RAND's Matheny on AI, X-Risk, & Bureaucracychinatalk.media
  2. 2.Matheny on RAND’s Legacy and Futurechinatalk.media
  3. 3.Canary: A collaboration between METR and RAND | The Audacious Projectaudaciousproject.org
  4. 4.Lennart Heim on the compute governance era and what has to come after | 80,000 Hours80000hours.org
  5. 5.New Support Through The Audacious Projectmetr.org
  6. 6.RAND Corporation - Wikipediaen.wikipedia.org
  7. 7.Jason Gaverick Matheny - Wikipediaen.wikipedia.org
  8. 8.Jason Matheny | Center for Security and Emerging Technologycset.georgetown.edu
  9. 9.Ella Guest – Horizon Institute for Public Servicehorizonpublicservice.org
  10. 10.Dr. Jason Mathenycnas.org
  11. 11.Lennart Heimheim.xyz
  12. 12.researchheim.xyz
  13. 13.Unknowncommerce.senate.gov
  14. 14.Congressional Concerns Over NIST's AI Research Partnership with RAND Corpentrelligence.com
  15. 15.RAND’s Role in Shaping Biden’s AI Policy Raises Questions About Influence | AI Explained | CryptoRank.iocryptorank.io
  16. 16.Science Committee Leaders Stress Importance of Diligence in NIST AI Safety Research Fundingscience.house.gov
  17. 17.The Long-Term Benefit Trustanthropic.com
  18. 18.How Anthropic Designed Itself to Avoid OpenAI’s Mistakestime.com
  19. 19.RAND Forecasting Initiativerandforecastinginitiative.org
  20. 20.Unknownhsgac.senate.gov
  21. 21.When RAND Made Magic + Jason Matheny Responsechinatalk.media
  22. 22.Science Committee Leaders Stress Importance of Diligence in NIST AI Safety Research Fundingthefederalnewswire.com
  23. 23.Sella Nevo | Homepagesellanevo.com
  24. 24.Sella Nevo | Impactsellanevo.com
  25. 25.ChinaTalk: RAND CEO Jason Matheny Gives a Masterclass on Risk and Organizational Designlawfaremedia.org
  26. 26.Sella Nevo on who's trying to steal frontier AI models, and what they could do with them | 80,000 Hours80000hours.org
  27. 27.On the Geopolitics of AGIgeopoliticsagi.substack.com
  28. 28.The RAND Corporation: America's University of Imperialismarchive.globalpolicy.org
  29. 29.Ep. 111 - From Cultivated Meat to National Security: The Journey of Jason Matheny — Business for Good Podcastbusinessforgoodpodcast.com
  30. 30.America’s Think Tankcjr.org
  31. 31.Rand Corporation - Nonprofit Explorer - ProPublicaprojects.propublica.org
  32. 32.RAND Corporation | Nonprofit Organization, Policy Analysis, Research | Britannicabritannica.com
  33. 33.Update on the Horizon Institute for Public Service – Horizon Institute for Public Servicehorizonpublicservice.org
  34. 34.Could AI help bioterrorists unleash a new pandemic? A new study suggests not yetthebulletin.org
  35. 35.How Pentagon Spending Perpetuates Pentagon Spending | Inkstickinkstickmedia.com
  36. 36.RAND Simulates a 'Robot Insurgency' to Test U.S. Readiness -- It Goes About as Well as You Might Expecttheaiinsider.tech
  37. 37.Sen. Cruz Sounds Alarm Over Industry Role in AI Czar Harris’s Censorship Agendacommerce.senate.gov
  38. 38.RAND Corp. Behind Biden's AI Executive Ordernewsmax.com
  39. 39.Anthropic Long-Term Benefit Trustcorpgov.law.harvard.edu