THE INTELLIGENCE EXPLOSION

If we let AI take the wheel, will it drive humanity to extinction?

The development of increasingly powerful AI systems may be steering humanity toward an existential crisis, says Barrat, an author and documentary filmmaker. Drawing from history, expert commentary, and industry analysis, Barrat proposes thinking in terms of an “intelligence explosion”—in which AIs rapidly self-improve, eventually outpacing human intelligence and slipping out of our control. Rather than a far-fetched dystopia, Barrat evokes an urgent threat, propelled by fierce competition between major tech companies like OpenAI, Google, Meta, and Microsoft. These corporations, he argues, have released unpredictable generative AI models and are racing to create artificial general intelligence (AGI) without fully understanding or addressing the risks. The result, according to Barrat and the experts he cites, will likely be catastrophic. One chilling comparison equates releasing open-source code to publishing plans for a nuclear bomb. Another AI expert envisions rogue data centers developing unchecked AI systems that must be destroyed to protect humanity. Despite the urgency of his tone, Barrat notes that AI does offer tangible benefits for medicine, robotics, and scientific research. From protein folding to factory automation, current AIs already surpass human performance in many specialized domains. But the book’s core concern remains the lack of safeguards, AI’s unpredictable emergent properties, and our present inability to align superintelligent systems with human values. Barrat’s argument is passionate and unapologetically skeptical of industry motivations. His plentiful notes make the book a valuable resource for readers looking to explore the topic further. This volume will satisfy those wondering why many respected researchers are sounding the alarm about AI, fearing a risky, high-stakes choose-your-own-adventure game where black-box models replace human decision-making. Barrat offers some hope, but he warns that smart AIs won’t stay confined to computers for long. Agree or disagree, this thought-provoking introduction will add context for those seeking to understand AI’s darker potential.

A gripping, unsettling critique of artificial intelligence carries a stark warning: control or be controlled.