← AI Safety Orgs

Daniel Kokotajlo

Independent Analyst

Insider → public voice. Equity forfeiture. Timeline forecasts.

HQ
Berkeley, CA
Team
1
Structure
individual
Model
Donations

Theory of Change

Kokotajlo's personal theory of change is to make the trajectory toward superintelligence visible and legible to policymakers and the public, creating political conditions for coordination over racing. He pursues this through four channels simultaneously:

  1. Scenario forecasting -- making abstract risk concrete through detailed, date-specific narratives (AI 2027, the forthcoming AI 2030)
  2. Tabletop exercises -- giving decision-makers visceral experience of AGI-era crises (35+ exercises with congressional staffers, lab researchers, journalists)
  3. Whistleblowing and advocacy -- establishing accountability norms for AI labs (Right to Warn, amicus brief against OpenAI's for-profit conversion, SB 1047 support)
  4. Policy development -- advocating specific mechanisms: hardware verification, transparency requirements, international coordination with mutual inspection

He is not trying to solve alignment directly. He is trying to buy time and change the political landscape so that alignment can be solved.

From the 80K Hours podcast (Jan 2026): "In the future, whoever controls all the AIs does not need humans. If you've only got one to five companies and they each have one to three of their smartest AIs in a million copies, then that means there's basically 10 minds that between those 10 minds get to decide almost everything."

What They Do

AI 2027 (April 2025): A 71-page scenario forecast reaching 1M+ readers. VP JD Vance and leaders of top AI companies reportedly read it. Written with Scott Alexander, Eli Lifland, Thomas Larsen, and Romeo Dean. Accompanied by five quantitative forecasts (compute, timelines, takeoff, AI goals, security). Informed by 30+ tabletop exercises. Reviewed by Carl Shulman, Helen Toner, Holden Karnofsky, Yoshua Bengio, and 60+ others.

Right to Warn (June 2024): Co-organized letter by former OpenAI employees calling for transparency. Endorsed by Bengio, Hinton, Russell. Directly influenced the AI Whistleblower Protection Act (bipartisan, introduced May 2025 by Grassley, Coons, Blackburn, Klobuchar). The AIWPA provides anti-retaliation protections, job restoration, double back pay, and prohibits contractual waivers of whistleblower rights.

OpenAI departure (April 2024): Resigned after "losing confidence in responsible AGI development." Refused non-disparagement clause, risking ~$2M equity (~85% family net worth). OpenAI reversed the policy; Altman called it "embarrassing."

Amicus brief (April 2025): Filed with 11 other former employees and Harvard professor Lawrence Lessig opposing OpenAI's for-profit conversion.

MATS mentorship (Summer 2026): Running an AI Futures Project stream at MATS, training next-generation researchers in scenario forecasting.

Forecasting track record: His 2021 "What 2026 Looks Like" anticipated chain-of-thought prompting, inference-time scaling, AI chip export controls, and $100M training runs before ChatGPT. His AGI median has shifted from 2027 (late 2022) to Dec 2030 (Jan 2026) in response to METR studies and model corrections.

Key People

Daniel Kokotajlo -- Executive Director, AI Futures Project. BA Philosophy (Notre Dame), MA Philosophy (UNC Chapel Hill). Career: AI Impacts (2019) -> CLR (~2020-21) -> OpenAI governance (2022-2024) -> AIFP (2025-). TIME 100 AI 2024 and 2025.

Eli Lifland -- Research Lead. #1 on RAND Forecasting Initiative all-time leaderboard. Co-founded Sage, worked on Elicit. His own AGI median is Jan 2035 -- significantly longer than Kokotajlo's.

Thomas Larsen -- Research Lead. Founded Center for AI Policy. Former MIRI researcher.

The core team is 5 people. Kokotajlo's position within the broader OpenAI safety exodus is significant: he was among the first to publicly resign, preceding departures by Jan Leike (Superalignment co-lead), Leopold Aschenbrenner, and eventually Mira Murati (CTO) and Ilya Sutskever. He reported that nearly half the ~30-person AGI safety staff had left by August 2024.

Money and Incentives

AI Futures Project: 501(c)(3) nonprofit, EIN 99-4320292 (previously Artificial Intelligence Forecasting Inc). Headquartered in Berkeley, CA. Needs $1.9-4.7M for 2026 operations.

Funding sources: Unknown. No grants found from Coefficient Giving, SFF, or any identified funder. Manifund page inaccessible. Accepts donations through every.org and DAFs. Website built by Lightcone Infrastructure; Scott Alexander volunteered writing; FutureSearch provided independent forecasting -- suggesting significant in-kind contributions from the rationalist/EA ecosystem.

Personal financial situation: Kokotajlo risked ~$2M OpenAI equity (retained after OpenAI reversed its NDA policy). He has skin in the game: offers monetary bets on predictions, pays bounties for errors found in his models ($500 to titotal, $500 to Peter Johnson).

Incentive analysis: Kokotajlo's incentives appear well-aligned with his stated mission. The equity sacrifice runs against financial self-interest. His main incentive risk is reputational: credibility depends on forecasting track record, which could bias toward defending past predictions. The recent 3-year timeline lengthening mitigates this concern. He does not receive funding from any AI lab.

What Others Say

Gary Marcus (external skeptic): AI 2027 is "a work of fiction, not science" and "a house of improbable longshots." More compellingly: it is "practically marketing materials" for AI companies and "puts wind in their sails." The China framing "feeds the worst fears of hawks, both in the US and China." Verdict: "Tall tales about the imminence of AGI aren't slowing down the AI race dynamic... they are speeding that very dynamic up."

Arvind Narayanan (Princeton, paradigm counter): "There is a long causal chain between AI capability increases and societal impact. Benefits and risks are realized when AI is deployed, not when it is developed." External bottlenecks (regulation, adoption, organizational change) cannot be overcome simply by improving AI's technical design, even by superintelligence. Acknowledges Kokotajlo's tech predictions were accurate but social impact predictions were "overall not directionally correct."

MIRI (insider critique): Agrees on direction but expects "more crazy, both in the sense of chaotic and in the sense of insane." The Slowdown ending is an "exercise in hope." The Race ending is "the only realistic path presented." Expects Agent-4 level models to "try to self-exfiltrate and set up dead-man's switches."

Vitalik Buterin: Accepts rapid capability gains as possible but argues AI 2027 "underrates defensive tech." In a world that cures cancer by 2029, defensive technologies also advance. Warns against the "one AI hegemon" strategy.

titotal (technical critic): Found specific bugs in timelines model, including a code error shifting the median by 9 months. AIFP acknowledged errors, paid $500 bounty, wrote 15K-word response.

Scott Alexander (collaborator): Notes team members have longer timelines than Daniel. "Skeptical" of very fast automation. Describes Slowdown ending as "exercise in hope."

Saffron Huang / Jessica Dai: AI 2027 "obscures human leverage and uses the authors' credentials to make doom seem inevitable."

What's Absent

  • AIFP funding sources: The single biggest factual gap. For an org seeking $1.9-4.7M that advocates transparency, the opacity is notable.
  • AIFP governance: No public board, no governance documents. Too new for 990s.
  • Current p(doom): The 70% figure (2024) is widely cited but likely outdated. If updated to 20-30%, this would be a significant shift.
  • OpenAI internal work: Kokotajlo's specific governance research outputs remain opaque.
  • Evaluation of 2025 predictions: The near-term predictions from AI 2027 should now be checkable, but no systematic public assessment was found.
  • Lab leader reactions: No specific public statements from Altman, Amodei, or Hassabis about AI 2027 were found.

Recommended Reading

  1. 80K Hours Podcast #225 (Jan 2026) -- Kokotajlo at his most candid and current. Discusses robot economy, updated timelines, China scenarios, METR studies, and the narrow path to good outcomes. Lead with this. https://80000hours.org/podcast/episodes/daniel-kokotajlo-ai-2027-updates-china-robot-economy/

  2. Arvind Narayanan, "AI as Normal Technology" (Sep 2025) -- The strongest intellectual counterpoint. Essential for anyone trying to calibrate between worlds where Kokotajlo is right vs. wrong. https://www.normaltech.ai/p/a-guide-to-understanding-ai-as-normal

  3. Gary Marcus, "The AI 2027 Scenario: How realistic is it?" (May 2025) -- The counterproductivity argument (AI 2027 as marketing material for labs) is the single most important challenge to Kokotajlo's theory of change. https://garymarcus.substack.com/p/the-ai-2027-scenario-how-realistic

  4. Kokotajlo & Lifland, "Clarifying how our AI timelines forecasts have changed" (Jan 2026) -- Complete timeline of AGI median estimates 2018-2026. Best source for understanding his intellectual honesty and updating behavior. https://blog.ai-futures.org/p/clarifying-how-our-ai-timelines-forecasts

  5. MIRI, "Thoughts on AI 2027" (Apr 2025) -- The critique from the even-more-concerned direction. Brackets the space between "too alarmist" and "not alarmist enough." https://intelligence.org/2025/04/09/thoughts-on-ai-2027/

Connected to (10)

MATSadvisor at · Daniel Kokotajlo
Astral Codex Tencollaborator · Scott Alexander
FutureSearchcollaborator
Lightcone Infrastructurecollaborator
The Midas Projectcollaborator
OpenAIstaff from · Daniel Kokotajlo
Center on Long-Term Riskstaff from · Daniel Kokotajlo
AI Impactsstaff from · Daniel Kokotajlo
Center for AI Policycollaborator · Thomas Larsen
Machine Intelligence Research Institutestaff from · Thomas Larsen
Sources (58)
Every URL that was read during research.
  1. 1.Daniel Kokotajlo (researcher) - Wikipediaen.wikipedia.org
  2. 2.Daniel Kokotajlotime.com
  3. 3.About — AI Futures Projectaifutures.org
  4. 4.AI Futures Projectaifutures.org
  5. 5.About — AI 2027ai-2027.com
  6. 6.The “AI 2027” Scenario: How realistic is it?garymarcus.substack.com
  7. 7.My response to AI 2027vitalik.eth.limo
  8. 8.Daniel Kokotajlo on what a hyperspeed robot economy might look like | 80,000 Hours80000hours.org
  9. 9.Our first project: AI 2027blog.ai-futures.org
  10. 10.OpenAI Safety Worker Quit Due to Losing Confidence Company "Would Behave Responsibly Around the Time of AGI"futurism.com
  11. 11.AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlodwarkesh.com
  12. 12.AI 2027: Responsesthezvi.substack.com
  13. 13.Thoughts on AI 2027 - Machine Intelligence Research Instituteintelligence.org
  14. 14.About - AI Futures Projectblog.ai-futures.org
  15. 15.OpenAI Insider Estimates 70 Percent Chance That AI Will Destroy or Catastrophically Harm Humanityfuturism.com
  16. 16.Former Engineer At Sam Altman-Led OpenAI Says He Resigned After Losing Confidence In The Company: 'Silencing Researchers And Making Them Afraid Of Retaliation Is Dangerous…'benzinga.com
  17. 17.OpenAI’s Sam Altman ‘embarrassed’ over staff exit contractseuronews.com
  18. 18.OpenAI whistleblower Daniel Kokotajlo on superintelligence and existential risk of AIgzeromedia.com
  19. 19.Why I'm Skeptical of AGI Timelines (And You Should Be Too)ignorance.ai
  20. 20.AI Futures Project - Wikipediaen.wikipedia.org
  21. 21.TIME100 AI 2025: Daniel Kokotajlotime.com
  22. 22.REPORT: The OpenAI Files Document Broken Promises, Safety Compromises, Conflicts of Interest, and Leadership Concerns - Tech Oversight Projecttechoversight.org
  23. 23.The ‘OpenAI Files’ push for oversight in the race to AGI | TechCrunchtechcrunch.com
  24. 24.Daniel Kokotajlo, Author at Center on Long-Term Risklongtermrisk.org
  25. 25.The OpenAI Files — Employee Testimoniesopenaifiles.org
  26. 26.The OpenAI Files — Transparency & Safetyopenaifiles.org
  27. 27.OpenAI subpoenas another nonprofit opposed to its restructuringsfstandard.com
  28. 28.The Midas Projectthemidasproject.com
  29. 29.Limitless: An AI Podcast | AI DEBATE: Runaway Superintelligence or Normal Technology? | Daniel Kokotajlo vs Arvind Narayananlimitless.bankless.com
  30. 30.BREAKING: The AI 2027 doomsday scenario has officially been postponedgarymarcus.substack.com
  31. 31.🌻 forecasts vs. fiction (ft. daniel kokotajlo)jasmi.news
  32. 32.Clarifying how our AI timelines forecasts have changed since AI 2027blog.ai-futures.org
  33. 33.Exaggerating the risks (Part 18: Introduction to AI 2027) - Reflective altruismreflectivealtruism.com
  34. 34.Former OpenAI researcher believes company is "fairly close" to AGI and not prepared for itthe-decoder.com
  35. 35.Ex-OpenAI researcher pushes back AGI timeline as progress slows - Capacitycapacityglobal.com
  36. 36.AI Futures Project at MATS: Summer 2026matsprogram.org
  37. 37.Scenario Scrutiny for AI Policyblog.ai-futures.org
  38. 38.The Midas Project - InfluenceWatchinfluencewatch.org
  39. 39.OpenAI's leadership shakeup continues as another of Sam Altman’s chiefs follows Ilya Sutskever out the door within hours | Fortunefortune.com
  40. 40.AI Whistleblower Protection Actkkc.com
  41. 41.A guide to understanding AI as normal technologynormaltech.ai
  42. 42.Daniel Kokotajlo (researcher) — Grokipediagrokipedia.com
  43. 43.The Departure of Daniel Kokotajlo from OpenAI | Deep Reason AIdeepreason.ai
  44. 44.Things Seem To Be Going Somewhat Slower Than The 'AI 2027' Scenario: Daniel Kokotajloofficechai.com
  45. 45.Introducing AI 2027astralcodexten.com
  46. 46.My Takeaways From AI 2027astralcodexten.com
  47. 47.AI 2027: Media, Reactions, Criticismblog.ai-futures.org
  48. 48.AI 2027news.ycombinator.com
  49. 49.The AI 2027 Scenariotheness.com
  50. 50.Daniel Kokotajlo - MATS Mentormatsprogram.org
  51. 51.Protecting AI Whistleblowerslawfaremedia.org
  52. 52.Response to titotal’s critique of our AI 2027 timelines modelaifuturesnotes.substack.com
  53. 53.Ex-OpenAI staffers file amicus brief opposing the company's for-profit transition | TechCrunchtechcrunch.com
  54. 54.'Disappointed but not surprised': Former employees speak on OpenAI's opposition to SB 1047 | TechCrunchtechcrunch.com
  55. 55.AMA With AI Futures Project Teamastralcodexten.com
  56. 56.OpenAI Employees Forced to Sign NDA Preventing Them From Ever Criticizing Companyfuturism.com
  57. 57.Dozens of AI workers buck their employers, sign letter in support of Wiener AI billsfstandard.com
  58. 58.OpenAI accused of using legal tactics to silence nonprofitsnbcnews.com