‘We may release models we can’t control’: Amodei, Altman … and Gemini Carbon
You know what, by AI standards, it might not have been the craziest week, but that doesn’t mean several headline-worthy things happened - from Altman and Anthropic implying they would release models they can’t control, with behavior they cannot verify, to Gemini 4 Carbon bursting onto the scene, some Amodei rationalization, de-tokenization and more… AI Insiders ($9!): https://www.patreon.com/AIExplained Chapters: 00:00 - Introduction 00:00 - Introduction 01:26 - Anthropic Staff Survey 04:32 - Amodei's Five Rationalisations 11:43 - Altman: Only Alignment Will Work 18:41 - Gemini 4 Carbon and Why Models Keep Impressing Anthropic: The AI expectations gap: https://www.anthropic.com/research/ai-expectations-gap Dario Amodei responds to Nathan Calvin: https://x.com/DarioAmodei/status/2112732230124818891 Anthropic Responsible Scaling Policy v3.0: https://www-cdn.anthropic.com/e670587677525f28df69b59e5fb4c22cc5461a17.pdf Responsible Scaling Policy v3 discussion: https://www.lesswrong.com/posts/HzKuzrKfaDJvQqmjh/responsible-scaling-policy-v3 Anthropic's core views on AI safety: https://www.anthropic.com/news/core-views-on-ai-safety Nathan Calvin on Anthropic's IPO risk disclosures: https://x.com/_NathanCalvin/status/2114720411413819410/photo/1 OpenAI: Securing frontier model training: https://openai.com/index/securing-our-frontier-model-training-environment/ Google: Introducing Gemini 4 Carbon: https://blog.google/innovation-and-ai/models-and-research/gemini-models/introducing-gemini-4-carbon/ SemiAnalysis: GDPx benchmark: https://x.com/SemiAnalysis_/status/2117075900575477855 The Information: OpenAI's next flagship and safety issues: https://www.theinformation.com/articles/openai-scrambles-fix-safety-issues-shipping-next-flagship-model AI Explained: Understanding Models — Impossible, Solved, or Not Needed?: https://www.patreon.com/AIExplained/posts/exclusive-models-172917747 Dario Amodei: We Must Pace the Frontier: https://darioamodei.com/post/we-must-pace-the-frontier Dario Amodei: The Adolescence of Technology: https://darioamodei.com/essay/the-adolescence-of-technology Evan Hubinger on recursive self-improvement risks: https://x.com/EvanHub/status/2097528891846074828 Leo Gao on AI lab employees' shrinking influence: https://x.com/nabla_theta/status/2115922100204810594 Jack Clark on superintelligence risks, BBC interview: https://x.com/aleshu_ber/status/2116988191597060409 Jack Clark: Import AI: https://jack-clark.net/ Dylan Patel's apology to Google over Gemini Carbon: https://x.com/dylan522p/status/2117092550842683671 SemiAnalysis: Gemini Is Cooked but GCP Is Cooking: https://newsletter.semianalysis.com/p/gemini-is-cooked-but-gcp-is-cooking Vivek Natarajan on Gemini Carbon and RSI: https://x.com/vivnat/status/2115497643216707621 Albert Gu on learning directly from raw data: https://x.com/_albertgu/status/2115502110578290900 Garrison Lovely: Screenshots of Tony Feng's model claims: https://x.com/GarrisonLovely/status/2116226357101199369/photo/1 Jason Clinton on worsening cyber threats: https://x.com/JasonDClinton/status/2113325263157395456 Jason Clinton: "We tried to warn the world": https://x.com/JasonDClinton/status/2113363809629020374 Mustafa Suleyman: Don't build conscious superintelligence: https://x.com/mustafasuleyman/status/2116913722878820528 Stockfish chess engine: https://en.wikipedia.org/wiki/Stockfish_(chess) Non-hype Newsletter: https://signaltonoise.beehiiv.com/ Podcast: https://aiexplainedopodcast.buzzsprout.com/
