← AI Safety Orgs

Partnership on AI

Governance

Industry consortium.

Founded
2016
HQ
San Francisco, CA
Team
35
Structure
501(c)(3) nonprofit
Model
Donations

Theory of Change

PAI's stated theory of change: multi-stakeholder convening produces guidelines and resources, which inform practice change and policy innovation. CEO Rebecca Finlay: "We develop tools, recommendations, and other resources by inviting voices from across the AI community and beyond to share insights that can be synthesized into actionable guidance. We then work to drive adoption in practice, inform public policy, and advance public understanding."

PAI's 2021 Strategic Plan identifies four intended outcomes: (1) an inclusive PAI community, (2) a better-informed public, (3) policy innovations by governments, (4) changes in practice by partners. The mechanism is convening -> research -> guidelines -> adoption.

PAI explicitly states it is "not a trade group or advocacy organization" and "will not be auditing or certifying organizations." The Synthetic Media Framework is described as "like a constitution, not a set of laws." There is no enforcement mechanism for any PAI output.

PAI has zero engagement with existential risk, AI alignment, or catastrophic AI scenarios. Its entire framework addresses near-term deployment harms: bias, fairness, media integrity, worker treatment, governance coordination.

What They Do

Most significant outputs:

  • AI Incident Database (2020-2022): Cataloged 1,200+ real-world AI failures. Spun off to independent nonprofit in 2022. Arguably PAI's most lasting concrete contribution -- a genuine public good.

  • Synthetic Media Framework (2023-present): 18 institutional supporters (BBC, Google, Meta, TikTok, Adobe, OpenAI). 16 case studies published in 2024. PAI's most widely adopted output and strongest evidence of engagement.

  • Model Deployment Guidance (2023): 22 guidelines for foundation model providers, tiered by capability and release type. Developed with 50+ experts including GovAI's Markus Anderljung.

  • Risk Assessment Tools Report (2019): Concluded algorithmic risk assessment tools are "unfit for use" in pretrial detention. PAI's most substantive policy stance. Internal documents reveal this conclusion was a compromise -- some researchers wanted stronger language.

  • Data Enrichment Sourcing Guidelines: Only two companies (DeepMind, OpenAI) are publicly documented as adopters.

  • ABOUT ML documentation project: Cited in the White House AI Bill of Rights (2022). Three pilot studies published.

  • Open Model Value Chain mapping (2024): Technically detailed analysis of risk mitigation strategies across the AI value chain, co-hosted with GitHub.

Policy influence markers: PAI's work has been cited by the FTC, NIST, OECD, the White House AI Bill of Rights, and referenced in EU AI Act transparency provisions. PAI hosted Policy Forums in London (2023) and New York (2024).

Notable absence: No work on compute governance, AI capability restrictions, or moratoriums. All outputs assume continued AI development and ask how to govern deployment.

Key People

Rebecca Finlay, CEO since October 2021. Former VP at CIFAR (Canadian Institute for Advanced Research) where she founded the AI & Society program. Not a technologist -- brings nonprofit management and science policy experience. Her podcast interviews are thoughtful, and she explicitly endorses regulation alongside voluntary frameworks.

Jerremy Holland (Apple, Director of AI Research) has chaired the board since October 2023, succeeding Eric Horvitz (Microsoft CSO), who was founding chair for 8 years. The board chair position has been held exclusively by Big Tech executives since founding.

Notable departures: Peter Eckersley, Director of Research (2018-2020), formerly EFF's Chief Computer Scientist, left to co-found the AI Objectives Institute (deceased 2022). Terah Lyons, founding Executive Director (2017-2021), departed to eventually become Global Head of AI Policy at JPMorgan Chase.

Team size: ~30-40 staff (estimated from salary data). Exact headcount not publicly disclosed.

Money and Incentives

Revenue: $6-9M/year. Peaked at $10.2M in 2018, stabilized around $6-8M. 2024 revenue ~$9M.

Revenue breakdown: ~90-100% contributions. No product revenue. Rental property income provides ~$400-500K/year (~6%). Revenue is entirely donation/grant-dependent.

Founding corporate funders: Apple, Amazon, Meta, Google/DeepMind, IBM, Microsoft provided "multi-year grants" at founding. Amount of each company's ongoing contributions is not publicly disclosed.

Named philanthropic funders: MacArthur Foundation ($3.3M over 2017-2025, ~$400K/year). Luminate (Omidyar Group, amount undisclosed).

Corporate partner model: Each for-profit partner makes an "annual charitable contribution" upon joining. With 128 partners, these contributions likely form a significant but undisclosed portion of revenue.

Net assets: Declining from $13.9M (2018) to $6.6M (2023), suggesting PAI has been spending down initial reserves.

Executive compensation: $2.29M in 2024, representing 27.4% of total expenses. CEO Finlay earned $337K + $31K other. The remaining ~$1.9M went to other executives. No public explanation for this spike. In normal years (2022-2023), total executive compensation was $432K-$868K (5-11% of expenses).

Incentive structure: PAI's survival depends on contributions from Big Tech companies. Board governance is shared between for-profit and nonprofit directors by bylaw, but the chair has always been a Big Tech executive. PAI's funding model explicitly classifies corporate contributions as "non-earmarked charitable contributions" to prevent formal conflicts of interest. However, the simpler mechanism -- organizational reluctance to antagonize funders -- requires no earmarking.

990 anomaly: The "contributions" line shows $31-37M for 2021-2023 versus $6-7M in actual revenue, indicating multi-year pledge accounting.

What Others Say

The strongest critique (The Intercept, 2019): Former MIT Media Lab researcher Rodrigo Ochigame reports that PAI's policy recommendations on criminal justice "aligned consistently with the corporate agenda." Joichi Ito privately told a billionaire that PAI "waters down stuff we try to say." In a private meeting with Ito, PAI co-founder Mustafa Suleyman acknowledged that PAI's promotion of "AI ethics" had become "whitewashing." An internal email stated: "Neither ACLU nor MIT nor any non-profit has any power in PAI."

Access Now resignation (2020): "We did not find that PAI influenced or changed the attitude of member companies or encouraged them to respond to or consult with civil society on a systematic basis." Access Now advocates for outright bans on certain technologies; PAI's framework/risk-assessment approach was fundamentally insufficient.

Academic analysis (2021): Study of 24 companies committed to responsible AI found 14 had taken no concrete implementation steps. Discusses PAI as a voluntary commitment with no enforcement mechanism.

Ethics washing framing: Carnegie Council defines ethics washing as "creating a superficially reassuring but illusory sense that ethical issues are being adequately addressed." Academic literature specifically cites industry-funded AI ethics initiatives as exemplars of this pattern.

Defense -- Finlay: "None of the work that we're doing at the Partnership on AI in any way should stop appropriate regulation. I've always been a supporter of governments attending to and being aware of and acting upon harms." She argues PAI serves companies that want to be responsible, gives civil society a seat at the table, and informs policymakers.

Defense -- sustained engagement: The ACLU maintained board-level engagement from founding through 2024 (7+ years). Carol Rose (ACLU) received a PAI Changemaker Award. If PAI were purely performative, sustained ACLU engagement would be hard to explain.

Community visibility: PAI has zero presence on LessWrong or EA Forum. No dedicated profile in any major tech publication (Wired, MIT Tech Review, The Verge). PAI operates below the radar of both the AI safety community and mainstream tech journalism.

What's Absent

  • No enforcement or compliance mechanism. PAI's guidelines are entirely voluntary.
  • Corporate funding amounts undisclosed. We cannot determine what each Big Tech company contributes.
  • No verified adoption data. Only 2 of 128 partners are publicly documented as implementing PAI guidelines.
  • No whistleblower or conflict-of-interest policies publicly documented.
  • No independent evaluation of impact has been commissioned.
  • No engagement with existential AI risk, alignment, or capability restrictions.
  • Staff headcount not disclosed despite promoting transparency.
  • Partner attrition not tracked publicly -- we know Access Now left but not who else.
  • 2024 executive compensation spike (27.4% of expenses) has no public explanation.

Recommended Reading

  1. The Intercept: "How Big Tech Manipulates Academia to Avoid Regulation" (2019) -- The most revealing source. A first-hand account from inside PAI's deliberations, documenting how corporate interests shaped outcomes and co-founders privately acknowledged "whitewashing." https://theintercept.com/2019/12/20/mit-ethical-ai-artificial-intelligence/

  2. MIT Sloan podcast: "Sharing AI Mistakes" with Rebecca Finlay (2024) -- The most candid interview with PAI's CEO. She makes the best case for multi-stakeholder governance while acknowledging regulation is also needed. https://sloanreview.mit.edu/audio/sharing-ai-mistakes-partnership-on-ais-rebecca-finlay/

  3. Access Now resignation letter (2020) -- The most concise articulation of PAI's structural problem: it cannot change corporate behavior. https://www.accessnow.org/access-now-resignation-partnership-on-ai/

  4. PMC: "Companies Committed to Responsible AI: From Principles towards Implementation and Regulation?" (2021) -- Thorough academic study of whether corporate AI ethics commitments translate to action. https://pmc.ncbi.nlm.nih.gov/articles/PMC8492454/

Connected to (10)

Centre for the Governance of AIcollaborator · Markus AnderljungOpenAIboard overlap · Brittany SmithGoogle DeepMindcollaborator
ACLUboard overlap · Esha Bhandari
Microsoftboard overlap · Natasha Crampton
Appleboard overlap · Jerremy Holland
Frontier Model Forumcollaborator
AI Incident Databasespun off from
Access Nowcollaborator
AI Objectives Institutestaff to · Peter Eckersley
Sources (54)
Every URL that was read during research.
  1. 1.Partnership on AI - Wikipediaen.wikipedia.org
  2. 2.About - Partnership on AIpartnershiponai.org
  3. 3.Our Funding - Partnership on AIpartnershiponai.org
  4. 4.Transparency and Governance - Partnership on AIpartnershiponai.org
  5. 5.Our Process - Partnership on AIpartnershiponai.org
  6. 6.Annual Report 2024 - Partnership on AIpartnershiponai.org
  7. 7.Meeting the Moment: Annual Report 2023 - Partnership on AIpartnershiponai.org
  8. 8.PAI’s Guidance for Safe Foundation Model Deploymentpartnershiponai.org
  9. 9.PAI’s Responsible Practices for Synthetic Mediasyntheticmedia.partnershiponai.org
  10. 10.A Joint Statement from Terah Lyons & PAI Board Chair on Executive Director Transition - Partnership on AIpartnershiponai.org
  11. 11.Rebecca Finlay named as CEO: A Letter from Eric Horvitz, Chair of the Board of Directors - Partnership on AIpartnershiponai.org
  12. 12.Partnership on AI Appoints Six New Members to Board of Directors - Partnership on AIpartnershiponai.org
  13. 13.How Big Tech Manipulates Academia to Avoid Regulationtheintercept.com
  14. 14.Companies Committed to Responsible AI: From Principles towards Implementation and Regulation?pmc.ncbi.nlm.nih.gov
  15. 15.Sharing AI Mistakes: Partnership on AI’s Rebecca Finlaysloanreview.mit.edu
  16. 16.AI Ethics, Ethics Washing, and the Need to Politicize Data Ethicspmc.ncbi.nlm.nih.gov
  17. 17.Data Privacy and Women’s Rights with Rebecca Finlay — The Radical AI Podcastradicalai.org
  18. 18.How to make AI safe, according to the tech giants, with Rebecca Finlay, CEO of PAI - London Futuristslondonfuturists.buzzsprout.com
  19. 19.Our Team - Partnership on AIpartnershiponai.org
  20. 20.Careers - Partnership on AIpartnershiponai.org
  21. 21.Partner Index - Partnership on AIpartnershiponai.org
  22. 22.Six AI Governance Priorities for 2026 - Partnership on AIpartnershiponai.org
  23. 23.AI and Human Rights: Protecting Data Workerspartnershiponai.org
  24. 24.Protecting AI’s Essential Workerspartnershiponai.org
  25. 25.Guidelines for AI and Shared Prosperity - Partnership on AIpartnershiponai.org
  26. 26.Partnership on AI Welcomes 10 New Partners - Partnership on AIpartnershiponai.org
  27. 27.Report on Algorithmic Risk Assessment Tools in the U.S. Criminal Justice System - Partnership on AIpartnershiponai.org
  28. 28.Partnership On Ai To Benefit People And Society - Nonprofit Explorer - ProPublicaprojects.propublica.org
  29. 29.Charity Navigator - Rating for Partnership on Ai to Benefit People and Societycharitynavigator.org
  30. 30.Access Now resigns from the Partnership on AI - Access Nowaccessnow.org
  31. 31.When AI Systems Fail: Introducing the AI Incident Database - Partnership on AIpartnershiponai.org
  32. 32.Policy Alignment on AI Transparency - Partnership on AIpartnershiponai.org
  33. 33.Ethics washing | Carnegie Council for Ethics in International Affairscarnegiecouncil.org
  34. 34.Partnership on AI Appoints Apple’s AI Research Director as Board Chairpartnershiponai.org
  35. 35.Partnership on AI Names Rebecca Finlay as CEO - Partnership on AIpartnershiponai.org
  36. 36.Research and Publications Archives - Partnership on AIpartnershiponai.org
  37. 37.Balancing Safety and Accessibility for Open Foundation Models - Partnership on AIpartnershiponai.org
  38. 38.Managing the Risks of AI Research: Six Recommendations for Responsible Publication - Partnership on AIpartnershiponai.org
  39. 39.Partnership on AIluminategroup.com
  40. 40.ABOUT ML - Partnership on AIpartnershiponai.org
  41. 41.Our Work - Partnership on AIpartnershiponai.org
  42. 42.Partnership on Artificial Intelligence to Benefit People and Society - MacArthur Foundationmacfound.org
  43. 43.Annual Report 2022 - Partnership on AIpartnershiponai.org
  44. 44.Partnering for Impact: Honoring PAI’s 2025 ChangeMaker Award Recipientspartnershiponai.org
  45. 45.What Role Did AI Play in the 2024 U.S. Election?partnershiponai.org
  46. 46.Developing General Purpose AI Guidelines: What the EU Can Learn from PAI’s Model Deployment Guidancepartnershiponai.org
  47. 47.Fairness, Transparency, and Accountability - Partnership on AIpartnershiponai.org
  48. 48.AI, Labor, and the Economy - Partnership on AIpartnershiponai.org
  49. 49.Meet the PAI Changemakerspartnershiponai.org
  50. 50.Terah Lyons - Wikipediaen.wikipedia.org
  51. 51.Risk Mitigation Strategies for the Open Foundation Model Value Chain - Partnership on AIpartnershiponai.org
  52. 52.The Top 10 PAI Blogs and Resources of 2025partnershiponai.org
  53. 53.Global Consensus on AI is Fragmented, PAI has a Planpartnershiponai.org
  54. 54.Building Trust and Defining the Future at PAI’s 2025 Partner Forumpartnershiponai.org