Can the AI Industry Regulate Itself? Stripe Wants PayPal, China Catches Up, NY Bans Datacenters

The Five Conditions That Make AI Self-Regulation Actually Work

Demis Hassabis proposed a self-regulatory organization for AI modeled on FINRA: industry-funded, federally overseen, run by independent technical experts. Frontier labs would submit models 30 days before release, benchmarks would update quarterly, and the body could coordinate slowdowns if catastrophic risks emerged. Every major lab signed on. The reception looked like consensus. David Sacks outlined five conditions he told Hassabis directly, none of which are in the current proposal. Without them, he argued, the SRO becomes the opening bid in a ratchet toward full government control. The five: first, broad representation including startups and open-source, not just the three largest labs, to prevent regulatory capture by incumbents. Second, review only true frontier models, defined as a step change above current state-of-the-art, so the leaders cannot use the process to tie up smaller competitors. Third, limit scope to catastrophic risk only, meaning cyber and CBRN (chemical, biological, radiological, nuclear), explicitly excluding disinformation and speech. Fourth, keep it voluntary until it proves it works before it becomes legally mandatory. Fifth, treat it as a substitute for a new government agency, not an addition to one. 'If it's just additive, then it defeats the purpose,' Sacks said. Without preemption written into law, he argued, this will not hold. The alternative Sacks called the FAA for AI, which Dario Amodei has repeatedly advocated. The FAA requires type certification for any new aircraft design, a process that takes 5 to 9 years for a new design and 3 to 5 years for major amendments. Applied to AI, that replaces a system releasing new model versions every few months with one requiring years of government approval per release. 'We will just simply lose the AI race if that happens because China is not going to abide by those rules,' Sacks said.