← AI Safety Orgs

Google DeepMind

Frontier Lab

Hassabis/Legg. Frontier Safety Framework.

Founded
2010
HQ
London, UK
Team
7,600
Structure
limited company (UK)
Model
Product Revenue

Theory of Change

Google DeepMind's theory of change is that building AGI -- which Hassabis defines as AI capable of genuine scientific hypothesis generation, not just economically useful labor -- is the fastest path to solving humanity's most pressing problems. In Hassabis's words: "I'd be very worried about society today if I didn't know that something as transformative as AI was coming down the line. I firmly believe that. It's almost like the cavalry."

The safety theory of change is that (a) alignment research is commercially motivated because misalignment is currently the bottleneck to useful products, (b) embedding safety researchers inside the lab building AGI gives them maximum influence over deployment decisions, and (c) the Frontier Safety Framework creates thresholds that trigger mitigations before dangerous capabilities emerge. The 145-page "Approach to Technical AGI Safety and Security" paper (April 2025) outlines defense-in-depth: amplified oversight, robust training, interpretability, and system-level security across four risk areas (misuse, misalignment, mistakes, structural risks).

Co-founder Shane Legg, who has been publicly concerned about AI existential risk since 2011, leads the AGI Safety Council. Allan Dafoe, founding director of GovAI, left academia to join GDM because he believes "Demis and Shane are the right leaders" and his impact is maximized by advising influential decision-makers from inside the lab. Rohin Shah frames the core argument: "Alignment work is sort of the bottleneck to actually getting useful products out into the world."

What They Do

Products. Gemini model family (3 Pro released Nov 2025) now matches or exceeds state-of-the-art on most benchmarks. 650+ million monthly active users. ChatGPT still holds 64.5% market share vs Gemini's 21.5%. Google embeds AI across Search (8.5B queries/day), Workspace (1B+ users), Android (2B devices), and Cloud ($70B annual run rate).

Science. AlphaFold predicted 200M+ protein structures, freely available, used by 3M+ researchers in 190 countries. Nobel Prize Chemistry 2024 for Hassabis and Jumper. Isomorphic Labs (drug discovery spinoff, raised $600M) entering human clinical trials with AI-designed drugs. AlphaEvolve solved open mathematical conjectures. Weather Lab outperformed physics-based models for cyclone forecasting.

Safety Research. Frontier Safety Framework published in three versions (June 2024 to Jan 2026) with Critical Capability Levels in autonomy, biosecurity, cybersecurity, ML R&D, and manipulation. Published 145-page AGI safety paper. Gemma Scope (400+ sparse autoencoders for interpretability). Scalable oversight research. Doubly-efficient debate protocol. MONA for reward hacking mitigation. Uniquely among frontier labs, GDM explicitly identifies deceptive alignment as a risk class.

Commitments Record. Signed CAIS extinction risk statement, Seoul Safety Commitments. Released Gemini 2.5 Pro without model card, violating White House, G7, and Seoul commitments (60 UK MPs accused Google of "breach of trust"). February 2025: dropped 2018 AI Principles pledge against weapons and surveillance, co-authored by Hassabis himself. Gemini 3 safety report withheld key safety numbers including manipulation efficacy data. Earlier precedent: in 2015-2017, DeepMind's Streams app accessed 1.6 million NHS patient records without adequate consent, leading to ICO findings of non-compliance. The data was subsequently transferred to Google Health, contradicting privacy assurances -- establishing a pattern of governance failures around sensitive data that predates the current safety structures.

Key People

Demis Hassabis (CEO, co-founder): Neuroscience PhD, chess prodigy, Nobel Laureate. Identifies as "a scientist first." Sets a higher bar for AGI than competitors ("Could an AI have come up with general relativity?"). Co-authored blog post dropping Google's weapons pledge. Calls Sundar Pichai daily.

Shane Legg (co-founder, Chief AGI Scientist): PhD in machine super intelligence. Concerned about AI x-risk since 2011. Predicted 50% AGI by 2028. Leads AGI Safety Council. The most x-risk-concerned co-founder at any major frontier lab.

Notable departures. Geoffrey Hinton left Google May 2023 to warn about AI risks: "I want to talk about AI safety issues without having to worry about how it interacts with Google's business." Won Nobel Physics 2024. Mustafa Suleyman (co-founder) departed 2019 amid bullying complaints, now CEO of Microsoft AI. 142 departures after the Brain/DeepMind merger. All 8 authors of the transformer paper ("Attention Is All You Need") have left. Noncompete enforcement (6-12 months, UK) is controversial. Counterpoint: 20% of 2025 AI hires were returning employees.

Safety team. ~30-50 people in core AGI alignment (Anca Dragan leading, Rohin Shah, Allan Dafoe, Dave Orr). Growing ~37-39% per year. Total GDM headcount: 6,000-7,600. No published safety-to-total ratio.

Money and Incentives

Corporate structure. Wholly-owned subsidiary of Alphabet Inc. (market cap ~$2.4T). No independent financials, no independent legal structure. DeepMind's 2021 bid for independent legal structure was rejected by Alphabet. All decisions ultimately answer to Alphabet's board and shareholders.

Scale of investment. Alphabet planned 2026 capex: $175-185B, mostly for AI compute. Pre-merger DeepMind (2020): GBP 826M revenue, all from internal Google payments. Google Cloud: $70B annual run rate, $240B backlog. Google designs its own TPU chips (Ironwood: 4,614 TFLOPS per chip), giving GDM a structural hardware advantage no competitor can replicate.

Revenue model. AI is embedded across Google's existing products, not a standalone business. This means Google can afford to move cautiously -- but competitive dynamics with OpenAI drive urgency regardless.

Military contracts. Project Nimbus: $1.2B joint contract with Amazon providing cloud/AI to Israeli government and military. Google's own internal report acknowledged "Google Cloud Services could be used for, or linked to, the facilitation of human rights violations." Third-party consultant recommended withholding AI tools. Google signed anyway. Contract may extend up to 23 years. Google fired 50+ employees who protested. At least 5 UK DeepMind staff resigned. Google restricted political discussion on internal forums.

Weapons pledge reversal. In February 2025, Google removed its 2018 AI Principles pledge against weapons and surveillance. The blog post was co-authored by Hassabis. Justified by "global competition." Human Rights Watch: "Google announces willingness to develop AI weapons." Google employees' 2018 petition (thousands signed, dozens resigned) that originally created the pledge has been effectively overridden.

Hedging. Google invested $2B in Anthropic -- a company founded by people who left over safety concerns, now a direct competitor. This hedges Google's bet: if GDM's approach fails, Google still has a financial interest in the safety-focused alternative.

No external funding. Zero Coefficient Giving/Open Phil grants (expected for a Google subsidiary). The separate "DeepMind Foundation" (EIN 822828614) has ~$856K assets and makes $500-$1000 grants in medical research -- irrelevant to GDM operations.

What Others Say

FLI AI Safety Index (Winter 2025): Grade C (2.08/4.0), third behind Anthropic (C+) and OpenAI (C+). Recommendations: strengthen risk-assessment rigor, make governance structures more actionable, reduce lobbying against state-level AI safety regulations.

Zvi Mowshowitz on the Frontier Safety Framework: "This document is weak and unambitious. It is disappointing relative to my expectations." Key weaknesses: the word "commit" never appears; checks only every 6x compute (widest gap of top 3 labs); mitigation plans are empty; misalignment addressed as "future work."

Zvi on Gemini 3: "The model is seriously misaligned in many ways... prone to hallucinations, crafting narratives, glazing." Safety report "repeatedly hides the football." Dan Hendrycks: "On safety -- jailbreaks, bioweapons assistance, overconfidence, deception, agentic harm -- Gemini is worse than GPT, Claude, and Grok."

Semafor: "Hassabis paradox: warning about AI race while leading the race."

Stuart Russell (FLI panel): "AI CEOs claim they know how to build superhuman AI, yet none can show how they'll prevent us from losing control... I'm looking for proof that they can reduce the annual risk of control loss to one in a hundred million. Instead, they admit the risk could be one in ten, one in five, even one in three."

Rohin Shah (GDM insider): "I'm not really sold on [doom narratives]... I expect AI systems will become more powerful relatively continuously... I would be generally in favour of the entire world slowing down on AI progress." On alignment difficulty: "Nobody has very compelling arguments that AI will be dangerous by default, or that it will be safe by default. We just don't know."

Allan Dafoe (GDM insider): Technology is "unstoppable" in the sense that competitive dynamics force adoption, "but the FORM it takes is shapeable." His theory of impact: "advising influential decision makers" like Hassabis and Legg who have "the right character."

What's Absent

No independent safety governance. Unlike Anthropic (LTBT with board veto) or even pre-restructuring OpenAI (nonprofit oversight), GDM has no structural mechanism for safety to override commercial pressure. All governance is internal to Alphabet. When asked what happens if DeepMind disagrees with Alphabet on safety, COO Lila Ibrahim said: "We haven't had that issue yet."

Secret ethics board. The board created as a condition of the 2014 acquisition has never been publicly disclosed. Hassabis says it's "all confidential." Nobody knows who was on it, whether it still exists, or what it did.

No financial transparency. As an Alphabet subsidiary, GDM's budget, safety spending, and resource allocation are all opaque. No way to verify claims about safety investment.

No published safety-to-total headcount ratio. Estimates suggest 30-50 people in core alignment out of 6,000-7,600 total. No public commitment to maintain or grow this ratio.

No safety-driven non-deployment decision. GDM has never publicly declined to release a model for safety reasons. The FSF's "aim" language (not "commit") makes halt commitments unenforceable.

Missing safety data. Gemini 3 safety report withheld manipulation efficacy numbers, propensity rates, and detailed external evaluation results. Pattern of selective disclosure.

No policy for disagreements with Alphabet. No escalation mechanism, no safety veto, no dead man's switch for when commercial and safety interests conflict.

Recommended Reading

  1. Rohin Shah on 80K Hours (https://80000hours.org/podcast/episodes/rohin-shah-deepmind-doomers-and-doubters/) -- The most candid insider view of GDM's safety thinking. Shah is remarkably honest about uncertainty, internal culture, and what alignment work actually involves. Start here for the unfiltered picture.

  2. TIME: Hassabis on AGI and AI in the Military (https://time.com/7280740/demis-hassabis-interview/) -- Hassabis directly confronted about the weapons pledge reversal. His rationalizations reveal how the gap between rhetoric and action works in practice. The strongest counterargument source.

  3. Zvi: On DeepMind's Frontier Safety Framework (https://thezvi.substack.com/p/on-deepminds-frontier-safety-framework) -- The most systematic external critique. Shows exactly where the FSF falls short compared to Anthropic's RSP and OpenAI's Preparedness Framework.

  4. The Intercept: Google and Project Nimbus (https://theintercept.com/2025/05/12/google-nimbus-israel-military-ai-human-rights/) -- Internal documents showing Google knew it couldn't control how Israel would use its AI technology and signed the contract anyway. The strongest evidence that commercial interests override stated principles.

  5. digidai: Google DeepMind After the Merger (https://digidai.github.io/2026/03/06/google-deepmind-real-fighting-power-two-years-after-merger/) -- What the Brain/DeepMind merger actually changed: culture collision, talent drain, research freedom compressed, the Bard/Gemini stumbles, and whether AlphaFold-style breakthroughs can continue under product pressure.

Connected to (10)

UK AI Security Institutecollaborator
METRevaluates
Microsoft AIstaff to · Mustafa Suleyman
Center for Human-Compatible AIstaff from · Anca Dragan, Rohin Shah
Character.AIstaff to · Noam Shazeer, Daniel De Freitas
Anthropicstaff to · Dario Amodei, Daniela Amodei, others
Centre for the Governance of AIstaff from · Allan Dafoe
Cooperative AI Foundationcollaborator · Allan Dafoe, Thore Graepel
Isomorphic Labsspun off from · Demis Hassabis
OpenAIstaff to · Ilya Sutskever, others
Sources (75)
Every URL that was read during research.
  1. 1.Google DeepMind - Wikipediaen.wikipedia.org
  2. 2.About Google DeepMinddeepmind.google
  3. 3.Responsibility & Safetydeepmind.google
  4. 4.Introducing the Frontier Safety Frameworkdeepmind.google
  5. 5.Google DeepMind strengthens the Frontier Safety Frameworkdeepmind.google
  6. 6.Demis Hassabis — Scaling, superhuman AIs, AlphaZero atop LLMs, AlphaFolddwarkesh.com
  7. 7.Shane Legg (DeepMind Founder) — 2028 AGI, superhuman alignment, new architecturesdwarkesh.com
  8. 8.Transcript for Demis Hassabis: Future of AI, Simulating Reality, Physics and Video Games | Lex Fridman Podcast #475 - Lex Fridmanlexfridman.com
  9. 9.Shane Legg - Wikipediaen.wikipedia.org
  10. 10.Demis Hassabis - Wikipediaen.wikipedia.org
  11. 11.Demis Hassabis Is Preparing for AI’s Endgametime.com
  12. 12.Allan Dafoe on why technology is unstoppable & how to shape AI development anyway | 80,000 Hours80000hours.org
  13. 13.Exclusive: 60 U.K. Lawmakers Accuse Google of Breaking AI Safety Pledgetime.com
  14. 14.DeepMindailabwatch.org
  15. 15.DeepMind UK staff move to unionise amid anger over defence deals and Israel linkscomputing.co.uk
  16. 16.Google DeepMind forms a new org focused on AI safety | TechCrunchtechcrunch.com
  17. 17.AI Safety Index Winter 2025 - Future of Life Institutefutureoflife.org
  18. 18.Mustafa Suleyman - Wikipediaen.wikipedia.org
  19. 19.Leading AI Companies Get Lousy Grades on Safetyspectrum.ieee.org
  20. 20.The Google Brain-DeepMind merger is probably good for Google. It might not be for us | Fortunefortune.com
  21. 21.Announcing Google DeepMinddeepmind.google
  22. 22.Taking a responsible path to AGIdeepmind.google
  23. 23.Google DeepMind Slammed by Protesters Over Broken AI Safety Promisetechtimes.com
  24. 24.Exclusive: Workers at Google DeepMind Push Company to Drop Military Contractstime.com
  25. 25.Google Worried It Couldn’t Control How Israel Uses Project Nimbus, Files Revealtheintercept.com
  26. 26.Rohin Shah on DeepMind and trying to fairly hear out both AI doomers and doubters | 80,000 Hours80000hours.org
  27. 27.What one founder's past says about AI's future : TED Radio Hournpr.org
  28. 28.Google violated AI safety commitments British lawmakers say in an open letter | Fortunefortune.com
  29. 29.PauseAI Presents: The Google DeepMind Protestpauseai.info
  30. 30.Letter to Sir Demis Hassabispauseai.info
  31. 31.Gemini 3: Model Card and Safety Framework Reportthezvi.substack.com
  32. 32.Advancing Gemini's security safeguardsdeepmind.google
  33. 33.Alphabet is confident about plans to double capex spending to a possible $185 billion—but it’s keeping CEO Sundar Pichai up at night | Fortunefortune.com
  34. 34.DeepMind's 145-page paper on AGI safety may not convince skeptics | TechCrunchtechcrunch.com
  35. 35.Google removes pledge to not use AI for weapons, surveillancecnbc.com
  36. 36.Google Announces Willingness to Develop AI for Weaponshrw.org
  37. 37.Anca Dragan named Head of AI Safety and Alignment at Google DeepMind - EECS at Berkeleyeecs.berkeley.edu
  38. 38.An Approach to Technical AGI Safety and Securityarxiv.org
  39. 39.On DeepMind's Frontier Safety Frameworkthezvi.substack.com
  40. 40.Frontier Safety Frameworks: Comprehensive Guide & Key Comparisons | Enkrypt AIenkryptai.com
  41. 41.AlphaFolddeepmind.google
  42. 42.Read Google DeepMind’s new paper on responsible artificial general intelligence (AGI).blog.google
  43. 43.Frontier AI Safety Policiesmetr.org
  44. 44.Google DeepMind’s Demis Hassabis and the paradox of AI progresssemafor.com
  45. 45.Google DeepMind CEO Demis Hassabis on AGI and AI in the Militarytime.com
  46. 46.Updating the Frontier Safety Frameworkdeepmind.google
  47. 47.Deepening our partnership with Google DeepMind | AISI Workaisi.gov.uk
  48. 48.Gemma Scope: helping the safety community shed light on the inner workings of language modelsdeepmind.google
  49. 49.Google DeepMind agrees to sweeping research collaboration with the U.K. government | Fortunefortune.com
  50. 50.Deepening AI Safety Research with UK AI Security Institute (AISI)deepmind.google
  51. 51.Google DeepMind has a new way to look inside an AI’s “mind”technologyreview.com
  52. 52.Google DeepMind wants to know if chatbots are just virtue signalingtechnologyreview.com
  53. 53.We read the paper that forced Timnit Gebru out of Google. Here’s what it says.technologyreview.com
  54. 54.Google's latest Gemini 2.5 Pro AI model is missing a key safety report in apparent violation of promises the company made to the U.S. government and at international summits | Fortunefortune.com
  55. 55.Google's latest AI model report lacks key safety details, experts say | TechCrunchtechcrunch.com
  56. 56.Google DeepMind After the Merger: Nobel Prizes, Bleeding Talent, and a $185 Billion Bet That Cannot Faildigidai.github.io
  57. 57.Why top AI talent is leaving Google’s DeepMindsifted.eu
  58. 58.Google axes its promise not to use AI for weapons or surveillance just weeks into the Trump presidency | Fortunefortune.com
  59. 59.Google erases promise not to use AI technology for weapons or surveillance | CNN Businesscnn.com
  60. 60.Geoffrey Hinton tells us why he’s now scared of the tech he helped buildtechnologyreview.com
  61. 61.Scalable AI Safety via Doubly-Efficient Debatedeepmind.google
  62. 62.Common Elements of Frontier AI Safety Policiesmetr.org
  63. 63.The ethics of advanced AI assistantsdeepmind.google
  64. 64.Deepmind Foundation | Cupertino, CA | 990 Report | Instrumentlinstrumentl.com
  65. 65.DeepMind now has an AI ethics research unit. We have a few questions for it... | TechCrunchtechcrunch.com
  66. 66.New role: AGI Alignment researchmistaketheory.substack.com
  67. 67.DeepMind CEO Demis Hassabis Urges Caution on AItime.com
  68. 68.Employees Say OpenAI and Google DeepMind Are Hiding Dangers from the Publictime.com
  69. 69.AI 2026: Sundar Pichai is Tasked With Preserving Googlebrief.bismarckanalysis.com
  70. 70.Google faces new suit over DeepMind NHS patient data scandaltechcrunch.com
  71. 71.Gemini 3.1 Pro - Model Carddeepmind.google
  72. 72.Researchdeepmind.google
  73. 73.Careers at Google DeepMinddeepmind.google
  74. 74.Building a culture of pioneering responsiblydeepmind.google
  75. 75.MONA: Myopic Optimization with Non-myopic Approval Can Mitigate Multi-step Reward Hackingdeepmind.google