The Scientific Reason We Can't Pause AI
The most dangerous assumption in AI safety is that we must control an AI that can outsmart us. The second is that we can control how fast we build it.
- The Forbes article identifies two core assumptions in AI safety as dangerous: controllability of superintelligent AI and the ability to slow development.
- It argues that competitive pressure among nations and companies (e.g., OpenAI, Google, China's AI labs) creates a race dynamic that makes any global pause unenforceable.
- Scientific reasons cited include the unpredictability of emergent capabilities and the impossibility of verifying compliance across decentralized open-source projects.
- The author suggests that regulatory efforts like the EU AI Act or the US executive order are too slow to match the pace of algorithmic advances.
- The piece concludes that safety research must shift from attempting to pause progress to building adaptive governance that scales with AI capability.
"The most dangerous assumption in AI safety is that we must control an AI that can outsmart us. The second is that we can control how fast we build it."
Frequently Asked Questions
Pausing AI development is hard because of competitive pressure between nations and companies, the decentralized nature of open-source AI, and the inability to verify compliance globally. Scientific unpredictability also means capabilities can emerge faster than any moratorium can adapt.
According to the Forbes article, the first dangerous assumption is that we can control an AI that is smarter than us. The second is that we can control the speed at which we build AI.
The article argues that enforcement is nearly impossible because AI progress is driven by multiple actors—including private labs, state-backed programs, and open-source communities—none of which are subject to a single authority. Verification of compliance would require unprecedented surveillance.
The alternative is to design adaptive safety systems that keep pace with AI progress rather than trying to freeze it. This includes iterative governance, real-time monitoring, and safety techniques that scale automatically.
No, the article takes a neutral tone. It does not advocate for speed; rather it argues that the current trajectory is scientifically difficult to pause and that safety approaches must adapt accordingly.
The scientific reason centers on the emergent and unpredictable nature of AI systems, combined with the competitive dynamics that fuel continuous improvement. No reliable mechanism exists to freeze a field that advances through distributed innovation.
Original source
www.forbes.com
Discussion
Join the discussion
Sign in to post a comment or reply.
No comments yet. Be the first to share your thoughts!