← AI Safety Orgs

Institute for Law & AI (LawAI)

Governance

Legal scholarship for x-risk.

Founded
2020
HQ
Boston, MA
Team
29
Structure
501(c)(3) nonprofit
Model
Grants

Theory of Change

LawAI's theory of change has evolved significantly. Founder Christoph Winter articulated the original vision in 2021: "Legal priorities research is applied global priorities research -- it's a subfield. We still try to solve the biggest problems globally. But we focus on the means of laws." The original Legal Priorities Project (2020-2023) pursued four cause areas: AI governance, biosecurity, institutional design, and meta-research, all through the lens of protecting future generations from existential risk.

The 2024 rebrand to "Institute for Law & AI" narrowed the focus exclusively to AI. The current theory is: policymakers lack legal expertise to write effective AI regulation; LawAI provides this expertise through research, direct consulting, and building a pipeline of trained legal professionals. Director of Research Cullen O'Keefe describes the approach: "I think we take AI safety related issues pretty seriously and have done work sketching out what forms of frontier AI regulation might look like. But I think we try to be attentive to how you could tailor frontier AI regulations to capture a lot of the safety benefits while also minimizing the costs."

The causal chain: produce rigorous legal analysis of AI governance challenges --> advise policymakers and draft model legislation --> train fellows who enter government and policy roles --> the resulting legal frameworks are more precise, resilient, and effective at constraining dangerous AI development.

What They Do

Research: Three teams (US Law & Policy, EU Law, Legal Frontiers) producing academic articles, policy reports, and rapid commentary. Output accelerated dramatically in 2025-2026 to 25+ publications. Key research programs:

  • "Law-Following AI" (LFAI): Flagship concept. AI agents should be designed to comply with laws, especially in government. Published in Fordham Law Review (2025). Contrasts with "AI henchmen" concept.
  • "Governance Misspecification Problem": Applies AI safety's misspecification concept to legal rules. Case studies showing how DMCA, CFAA, and export controls failed through proxy terms.
  • "Automated Compliance": AI itself can automate regulatory compliance, loosening the safety-vs-innovation tradeoff. Proposes "automatability triggers" where regulation activates only when compliance automation exists.
  • "Mapping AI Policy": Comprehensive primer organizing AI harms into 6 categories with 7 design factors. Written for state legislators.
  • "AI Rights for Human Safety": Game-theoretic argument that granting AI private law rights creates economic interdependence promoting peace. Virginia Law Review.
  • Policy analysis of existing legal authorities, frontier model definitions, compute thresholds, whistleblower protections.

Consulting: Direct advisory to governments and international organizations. Services include drafting model legislation, reviewing proposed policy, briefing legislative staff. Submitted detailed comments to California's Joint Policy Working Group on AI Frontier Models (April 2025) covering liability, whistleblowers, and scoping/definitions.

Field-building: Seasonal research fellowships (summer and winter) across US, EU, and Legal Frontiers tracks. Summer 2025: 19 fellows. Compensation at $1,500/week (US). In-person weeks in DC, Berkeley, and Cambridge. Alumni reportedly placed at Commerce Department, EU AI Office, and UK AISI.

Publications in top venues: Fordham Law Review, Virginia Law Review, Harvard JOLT, Oxford University Press. Regular publication in Lawfare.

Key People

Christoph Winter (Founder/Director): Cambridge-trained in law, philosophy, and psychology across six universities. Now Assistant Professor of Law & AI at Cambridge LCFI (since Dec 2024), simultaneously directing LawAI. Conceived the org at Harvard Law's EA group in 2018. Took zero compensation in founding years.

Cullen O'Keefe (Director of Research, joined April 2024): Harvard Law JD, 4.5 years at OpenAI in policy/legal roles. Left OpenAI alongside Jan Leike, Leopold Aschenbrenner, and Daniel Kokotajlo in spring 2024 safety departures. Did not sign the pro-Altman letter. Also Research Affiliate at GovAI and VP at O'Keefe Family Foundation. The primary public voice and intellectual driver of current research agenda.

Team size: ~29 people (US and UK). Key senior staff include Mackenzie Arnold (Director of US Policy, former 3rd Circuit clerk), Matthijs Maas (Senior Research Fellow, author of OUP book on global AI governance), and Alan Rozenshtein (Visiting Senior Fellow, simultaneously Research Director at Lawfare).

Money and Incentives

Revenue trajectory (from 990 filings):

Year Revenue Assets
2020 $156K $106K
2021 $750K $481K
2022 $1.46M $793K
2023 $963K $262K
2024 $7.85M $6.06M

Known grants ($1.94M total, accounting for ~17% of lifetime revenue):

  • FTX Future Fund: $1.18M (2022) -- grant disbursed before FTX collapse in November 2022
  • Survival and Flourishing Fund (Jaan Tallinn): $483K across three grants (2021-2023)
  • Open Philanthropy: $279K across three grants (all 2023)

The $7.7M mystery: The 2024 filing shows $7.7M in contributions from unknown source(s). This is 98.1% of that year's revenue. No professional fundraising fees were paid. Known grant funding ($1.94M) accounts for ~17% of lifetime revenue, leaving significant funding unattributed. The identity of the major 2024 donor(s) is undisclosed.

Revenue structure: 98% contributions/grants, 2% program services (consulting). Zero investment income, zero fundraising expenses. This is a purely philanthropic-funded think tank with minimal earned revenue.

Compensation (2024 990): Winter $193K, Van Arsdale $157K (including benefits), Bullock $136K (including benefits). Total salary expenses $888K against $7.85M revenue. The org is building a substantial reserve ($6.06M in assets).

Business model: Grants and major donor contributions. No apparent economic ties to AI labs. O'Keefe's former employment at OpenAI is notable but he left in the context of safety departures, and OpenAI is not a known funder.

Incentive analysis: The unknown major donor creates the primary incentive question. If the funder is an EA-aligned philanthropist (likely given the org's history), incentives may align with stated mission. If the funder has industry ties, the "independent think tank" framing becomes questionable. The Lawfare connection (through Rozenshtein) provides publication access but not funding.

What Others Say

Founders Pledge (May 2024): "LawAI fills an important and neglected niche in AI policy... Legal professionals trained by LawAI have gone on to positions of policy influence, and LawAI itself has provided valuable guidance to legislators and policymakers at the national and international level... LawAI could make use of considerable additional funding."

Miles Brundage (former OpenAI policy lead): Endorsed O'Keefe's move to LawAI publicly.

No substantive published criticism exists. Despite extensive searching, no published piece critically evaluates LawAI's approach, methodology, or impact. The org operates in a legal-academic niche that doesn't generate EA Forum debates or public controversy. The closest to internal criticism comes from O'Keefe himself acknowledging on Lawfare: "I think it would be bad if we try to make this project hinge on having a philosophical account of both the law generally and the exact application of every single law to every imaginable circumstance."

The automated compliance podcast reveals intellectual honesty: co-authors O'Keefe and Frazier explicitly disagree on the pro-regulation vs. deregulation spectrum but collaborated anyway. O'Keefe: "I'm quite worried that if we don't regulate now, there will kind of never be another opportunity to regulate, or by the time there's another opportunity to regulate, it'll be too late."

What's Absent

  • Source of $7.7M in 2024 funding is unknown. For an org claiming independence, this opacity is concerning.
  • No public annual report since 2022. No donor disclosure, no impact metrics. Unusual for a think tank of this size.
  • No evidence of specific policy wins. The org claims to advise governments but no specific legislation, regulation, or policy outcome is publicly attributed to their influence.
  • No external critical assessment. The analysis relies entirely on the org's self-presentation and sympathetic evaluators.
  • Zero EA Forum presence despite EA origins and EA funding. The org has very low visibility in the community that originally supported it.
  • No EU-specific publications visible despite having an EU Law team and EU fellows.
  • Fellowship alumni placements claimed (Commerce Dept, EU AI Office, UK AISI) but not documented by name.

Recommended Reading

  1. Scaling Laws podcast: Automated Compliance (Feb 2026) -- O'Keefe's most candid appearance. Reveals how he thinks about regulation, where he disagrees with co-author, and what the org is really trying to do. https://www.lawfaremedia.org/article/scaling-laws--can-ai-make-ai-regulation-cheaper---with-cullen-o'keefe-and-kevin-frazier

  2. Hear This Idea podcast with Christoph Winter (Oct 2021) -- The founding vision, before the rebrand and growth. Winter talks openly about uncertainty, strategy, and why legal priorities research matters. https://hearthisidea.com/episodes/christoph/

  3. The Governance Misspecification Problem (Oct 2024) -- Best single paper for understanding LawAI's distinctive contribution. Shows how legal rules fail through proxy terms, with case studies directly relevant to AI governance. https://law-ai.org/the-governance-misspecification-problem/

  4. Lawfare: AI Agents Must Follow the Law (May 2025) -- Accessible summary of the LFAI framework with the "AI henchmen" concept. Good counterpoint: what happens when government AI doesn't have to follow the law? https://www.lawfaremedia.org/article/ai-agents-must-follow-the-law

  5. ProPublica 990 Data -- Raw financial data showing the explosive growth trajectory. https://projects.propublica.org/nonprofits/organizations/851024198

Show Claude’s analysis
An opinionated read. Read the brief first to form your own view.

Stated Theory of Change

LawAI's stated theory is that sound legal analysis will promote security, welfare, and the rule of law in the age of AI. The causal chain is:

  1. AI governance requires specialized legal expertise that policymakers lack
  2. LawAI produces rigorous legal research on AI governance challenges
  3. This research directly informs legislation and regulation (through papers, consulting, and policy comments)
  4. LawAI trains fellows who enter government and policy positions
  5. The result is AI regulation that is more precise, constitutionally sound, and resistant to misspecification
  6. Better regulation reduces catastrophic risk from AI while enabling beneficial innovation

The org's founder originally articulated this as "applied global priorities research through the means of law" -- using legal tools to address the world's biggest problems, with AI as the highest priority.

Revealed Theory of Change

The org's actions reveal a theory that is largely consistent with but more specific than the stated version. What they actually do:

Primary mechanism: Build intellectual infrastructure for AI regulation. The LFAI framework, governance misspecification concept, automated compliance model, and frontier model definitions work collectively provide a conceptual toolkit that policymakers can draw on. This is analogous to what the Brookings Institution or RAND does for defense policy -- you shape the conversation by being the people who have thought most carefully about the technical details.

Secondary mechanism: Serve as rapid-response legal analysts. The 25+ publications in 2025-2026, including commentary published within days of executive orders and state bills, positions LawAI as the go-to resource for real-time AI legal analysis. The Lawfare pipeline (through Rozenshtein) amplifies this enormously.

Tertiary mechanism: Train the next generation. The fellowship program is genuine field-building. There simply aren't enough lawyers who understand both AI capabilities and constitutional law. LawAI is trying to create that talent pool.

Where stated and revealed diverge: The org's research agenda includes forward-looking topics -- government-developed frontier AI, AI-enabled governance, AI rights as a strategic tool -- that go well beyond "help policymakers write better laws." These topics reveal the underlying x-risk concern that the neutral branding obscures. The rebrand from "Legal Priorities Project" (explicitly longtermist) to "Institute for Law & AI" (neutral think tank) is strategic -- it makes the work legible to policymakers who wouldn't engage with EA-branded research. This is arguably savvy rather than deceptive.

One notable absence in revealed priorities: The original 2021 vision included courts and litigation as a key pathway. Winter said: "going through the courts could be a viable option." This has been almost entirely deprioritized in favor of the legislative/executive approach. The $34K South Asia litigation grant from Open Phil appears to have been the last gasp of this thread.

Key Assumptions

Assumption 1: Legal frameworks matter for AI risk. If transformative AI arrives faster than legal systems can adapt, or if leading AI companies simply ignore legal constraints (as tech companies routinely do with privacy law), then legal scholarship has limited impact. Evidence for: Law has successfully constrained nuclear technology, genetic engineering, and other dangerous technologies. Evidence against: Law has failed to meaningfully constrain social media companies, cryptocurrency, or surveillance technology before harm occurred. Testable: Track whether any LawAI-influenced legislation actually constrains frontier AI development. If wrong: The entire theory of change collapses.

Assumption 2: Policymakers will listen to academic legal analysis. The consulting arm suggests LawAI believes direct engagement matters more than just publishing. But the evidence of specific policy influence is thin. Evidence for: The Founders Pledge assessment says LawAI "has provided valuable guidance to legislators and policymakers." California comments show direct engagement. Evidence against: No specific policy outcomes are publicly attributed to LawAI's work. The AI governance space is crowded with think tanks. Testable: Can LawAI point to specific legislative language or regulatory provisions that reflect their analysis? If wrong: The org produces high-quality scholarship that is cited in law reviews but ignored by legislatures.

Assumption 3: The legal-academic niche is genuinely neglected. Founders Pledge calls this "important and neglected." But Stanford Law, Harvard Law, and Georgetown (CSET) all have AI governance programs. Evidence for: Few orgs specialize specifically in the legal mechanics of AI regulation (as opposed to general AI policy). LawAI's work on proxy terms, compute thresholds, and model definitions is distinctively detailed legal analysis. Evidence against: GovAI covers similar territory. CSET at Georgetown does related work. The niche may be less neglected than claimed. If wrong: LawAI's marginal contribution is smaller than it appears.

Assumption 4: The LFAI framework is technically feasible. Law-Following AI requires AI systems to interpret and comply with open-textured natural-language laws. O'Keefe acknowledges the challenges: "we're not going to be able to have something completely theorized." Evidence for: Current LLMs already show impressive legal reasoning capabilities. AI companies are already instructing models to follow laws. Evidence against: Legal interpretation is contested even among human experts. Jurisdiction-dependent, evolving, and politically charged. O'Keefe himself says "very few people agree on like the underlying philosophy of law." Testable: Watch whether frontier AI companies implement anything resembling LFAI. If wrong: The flagship concept is interesting academic work that doesn't translate to practice.

Assumption 5: The $7.7M funder(s) are aligned with the mission. The org's independence depends on who provides 98% of its revenue. Evidence for: The org's history with SFF and Open Phil suggests EA-aligned funding. Evidence against: We literally don't know. If wrong: Funder misalignment could shape research priorities invisibly.

Strengths

Genuinely distinctive niche. No other org combines deep legal scholarship (law review publications), practical policy work (drafting model legislation), rapid commentary (Lawfare pipeline), and field-building (fellowship program) in the AI governance space. GovAI is more academic, CSET is more quantitative, and RAND is broader. LawAI fills a specific gap.

Intellectual ambition and honesty. The governance misspecification paper, AI rights paper, and automated compliance work show willingness to take novel positions and engage with uncomfortable ideas. The automated compliance podcast, where co-authors explicitly disagree and say so publicly, demonstrates intellectual culture that is rare in advocacy organizations.

O'Keefe as a unique asset. Having a former OpenAI policy researcher who left in the safety departures wave gives the org both insider knowledge and credibility. O'Keefe's ability to articulate AI safety concerns in legal language (AI henchmen, LFAI) bridges the gap between the technical alignment community and the legal/policy world.

Strategic positioning. The Lawfare connection provides massive distribution. The Cambridge affiliation provides academic credibility. The neutral branding makes the work legible to policymakers across the political spectrum. The fellowship program creates a long-term talent pipeline.

Financial stability. After nearly running out of money in 2023 ($262K in assets), the org now has $6M+ in reserves. This provides runway for multi-year research programs without the grant-chasing that distorts many think tanks.

Weaknesses and Risks

Funding opacity undermines the independence claim. An org that receives 98% of its revenue from unknown donor(s) and describes itself as "independent" is asking for trust it hasn't earned. Most comparable think tanks disclose at least category-level donor information. The absence of an annual report since 2022 compounds this.

No demonstrated policy impact. The org may be producing excellent legal scholarship that nobody reads. The California comments are the most visible engagement, but their effect is unknown. Without evidence of specific policy outcomes, the theory of change is aspirational rather than demonstrated.

Potential for Overton window distortion. By publishing in Lawfare and top law reviews, LawAI has outsized influence on how the AI governance conversation is framed. The LFAI concept in particular could shape policy debates in ways that benefit AI companies (by suggesting the problem is "make AI follow existing laws" rather than "restrict AI capabilities"). This may not be intentional, but the structural incentive exists.

Dependence on one funder. If the $7.7M came from a single donor (likely given the lack of fundraising infrastructure), the org is extremely vulnerable to that donor's continued support and potential shifting priorities.

Key person risk. The intellectual agenda is heavily shaped by O'Keefe. If he leaves, the org loses its most visible voice, its AI safety community credibility, and its connection to the OpenAI diaspora.

EU work appears underdeveloped. Despite having an EU Law team, published output is overwhelmingly US-focused. The EU AI Act is the most significant piece of AI regulation globally, and LawAI's analysis of it is not publicly visible.

Cross-References

Complementary: GovAI (Oxford-based, more academic and quantitative), CSET (Georgetown, more empirical and data-driven), IAPS (broader AI policy). LawAI provides the specifically legal analysis that these orgs lack depth in.

Related: CLTR (Centre for Long-Term Resilience, UK-based policy), Lawfare (national security law publication platform, not an org in the same sense). The Lawfare relationship is not competitive but symbiotic.

Ecosystem position: LawAI sits between the EA/AI safety community (where it originates) and the mainstream legal/policy world (where its work lands). It functions as a translation layer -- converting x-risk concerns into the language of constitutional law, statutory interpretation, and regulatory design. This positioning is inherently valuable but also creates the rebrand-as-opacity risk.

Staff network: O'Keefe from OpenAI, Koessler alumni to GovAI, Araujo alumni to Rethink Priorities, Salib connection to CAIS. The org is well-embedded in the AI safety governance network.

What Would Change This Assessment

Upward: (1) Evidence of specific policy wins -- a bill, regulation, or executive order demonstrably shaped by LawAI analysis. (2) Disclosure of the 2024 major donor(s), showing alignment with mission and absence of conflicts. (3) An external, critical evaluation from a credible source finding the work to be high-quality and impactful. (4) Fellowship alumni achieving senior policy positions and attributing their training to LawAI.

Downward: (1) Revelation that the major funder has industry ties (AI lab, tech company). (2) Evidence that research conclusions are shaped by funder preferences. (3) Key departures (especially O'Keefe) without adequate succession. (4) The LFAI framework being adopted by AI companies primarily as a liability shield rather than a genuine safety measure. (5) Continued failure to demonstrate any concrete policy impact after 2+ more years.

Self-Critique

Weakest claim: My assessment of the org's "genuine distinctiveness" may overweight the legal specialization. The AI governance policy space has many players, and it's unclear how much the specifically legal angle matters versus general policy analysis. I'm relying on Founders Pledge's "important and neglected niche" assessment without independent verification.

Potential bias: The evidence base is almost entirely self-generated by LawAI. Without external critics, I'm evaluating the org primarily through its own lens. The absence of criticism doesn't mean the work is above criticism -- it may mean the work is too niche to attract attention.

What a thoughtful disagreer would say: "LawAI is producing legal scholarship for legal scholars. The people who actually write AI regulation -- congressional staffers, agency rulemakers -- don't read law review articles. The consulting arm is the only part that matters for real-world impact, and we have zero evidence of its effectiveness. This is an academic project dressed up as policy influence."

Single weakest claim: That the LFAI framework will have meaningful real-world impact on how AI agents are governed. The concept is intellectually interesting but may be too novel and too dependent on contested legal philosophy to translate into enforceable regulation.

What would most change my view: Seeing the 2024 990 filing's Schedule I (if it exists) or the actual text of the major grant agreement. Understanding who provided the $7.7M and what conditions attached would fundamentally reshape the analysis. A critical academic response to the LFAI paper from a prominent legal scholar would also be very informative.

Connected to (10)

Sources (44)
Every URL that was read during research.
  1. 1.Institute for Law & AIlaw-ai.org
  2. 2.Teamlaw-ai.org
  3. 3.Researchlaw-ai.org
  4. 4.Consultinglaw-ai.org
  5. 5.Open Positionslaw-ai.org
  6. 6.Christoph Winter on the Legal Priorities Projecthearthisidea.com
  7. 7.Law-Following AI: Designing AI Agents to Obey Human Lawslaw-ai.org
  8. 8.The Governance Misspecification Problemlaw-ai.org
  9. 9.Superintelligence and Lawlaw-ai.org
  10. 10.Institute for Law and AI (LawAI)founderspledge.com
  11. 11.Cullen O'Keefelaw-ai.org
  12. 12.Cullen O'Keefecullenokeefe.com
  13. 13.Support Uslaw-ai.org
  14. 14.Christoph Winterlaw-ai.org
  15. 15.Legal Priorities Inc - Nonprofit Explorer - ProPublicaprojects.propublica.org
  16. 16.Matthijs Maaslaw-ai.org
  17. 17.Mackenzie Arnoldlaw-ai.org
  18. 18.Legal Alignment for Safe and Ethical AIlaw-ai.org
  19. 19.Building AI Surge Capacity: Mobilizing Technical Talent Into Government for AI-Related National Security Criseslaw-ai.org
  20. 20.Mapping AI Policy: Where, Why, and How to Intervenelaw-ai.org
  21. 21.Legal Priorities Projectai.givewiki.org
  22. 22.Automated Compliance and the Regulation of AIlaw-ai.org
  23. 23.[Closed] Summer Research Fellowship (US)law-ai.org
  24. 24.Seasonal Research Fellowshipslaw-ai.org
  25. 25.OpenAI is haemorrhaging safety talenttransformernews.ai
  26. 26.LawAI’s Comments on the Draft Report of the Joint California Policy Working Group on AI Frontier Modelslaw-ai.org
  27. 27.Institute for Law & AI - Existing Authorities for Oversight of Frontier AI Modelslaw-ai.org
  28. 28.OUP Book: Architectures of Global AI Governancelaw-ai.org
  29. 29.Lawfare Daily: Cullen O’Keefe on the Impending Wave of AI Agentslawfaremedia.org
  30. 30.AI Agents Must Follow the Lawlawfaremedia.org
  31. 31.Recommendations | Survival and Flourishing Fundsurvivalandflourishing.fund
  32. 32.Why Give AI Agents Actual Legal Duties?law-ai.org
  33. 33.Future Frontiers for Research in Law and AIlaw-ai.org
  34. 34.Christoph Winter - LCFIlcfi.ac.uk
  35. 35.Protecting AI Whistleblowerslaw-ai.org
  36. 36.Unbundling AI Opennesslaw-ai.org
  37. 37.xAI’s Trade Secrets Challenge and the Future of AI Transparencylaw-ai.org
  38. 38.Scaling Laws: Can AI Make AI Regulation Cheaper?, with Cullen O'Keefe and Kevin Frazierlawfaremedia.org
  39. 39.Advanced AI Governance: A Literature Review of Problems, Options, and Proposalslaw-ai.org
  40. 40.AI Rights for Human Safetylaw-ai.org
  41. 41.Legal Considerations for Defining “Frontier Model”law-ai.org
  42. 42.Draft Report of the Joint California Policy Working Group on AI Frontier Models—Liability and Insurance Commentslaw-ai.org
  43. 43.Legal Priorities Project - Organizationidealist.org
  44. 44.Legal Priorities Project | The Orgtheorg.com