Review: Our Final Invention by James Barrat

There are many different books about the robot apocalypse, but few are so well researched, or as urgent, as Our Final Invention, by James Barrat. I have a passion for Artificial Intelligence, probably born from too many Sci-Fi movie marathons. The philosophy mixed with the science and the unknown excites me. But Barrat doesn’t exactly come from a pro - AI viewpoint. He believes that AI will be the last technology developed by the human race. Our Final Invention is a book about the dangers of Artificial Superintelligence, when machines surpass human capability to predict or control them. It aims to educate readers about the most current AI research, while moving them to act on the dangers that could appear if the research continues unchecked. Was it successful? 

The first thing I noted about this book was that it was very easy to read. Even though the material covered is sometimes complicated and advanced, the analogies and writing style is easy to comprehend. Some of the ideas are a little harder to digest once you understand them, and I think part of that has to do with the reverse-chronological path Barrat takes through the topic. He starts with something called the "Busy Child" scenario: a situation where a super-advanced AI decides it can't achieve its goal in confinement, tries to escape it's human captors. For this chapter, and the next two or three, I was rampantly annoyed. Every few sentences I found myself saying "Yes! But..." See for yourself! The chapter can be read online here.

The problem is that Barrat makes his claims in a sensational, provocative tale BEFORE he gives you the facts he has to back them up. And facts he has. His research covers the political, technological, and social ramifications of AI, from futurists to researchers to what's already here. Late in the book, he has a chapter comparing future advanced AI to the current rising problem of malware, and it is brilliant and terrifying. Once I read the rest of the book, I had to go back and reread the first few chapters. What I hadn't seen before was this: When Barrat says AI, he doesn't mean the kind that controls industrial machinery, or even government drones. The kind that has built in safety precautions from a savvy engineer. He is talking about the hundreds of researchers trying to skip the middle step, who are only concerned with developing human level intelligence as fast as they can. With that precinct, the "Busy Child" scenario becomes much more real. 

Now this is not a perfect book. One thing that annoyed me was Barrat's claims that we shouldn't anthropomorphize AI, shouldn't assume it would appreciate us, or even consider us worthy, when a few chapters later he was discussing the four basic drives of AI, which seemed rather anthropomorphic to me. (And don't even get me started on the gross oversimplification that is "friendly AI") And only the last chapter of the book is focused on ways to stop this impending doomsday. I wish there had been more discussion of prevention, of precaution, not just an afterthought, because I do believe that this isn't just going to become relevant in five years - it's relevant NOW. Back to government drones - or even worse, Amazon's proposed domestic drones - what happens if one of these drones is captured, and destructively reprogrammed? If it becomes slave to a botnet? These are the concerns Barrat feels moved to act on. Does his book succeed at moving others too? I'd say... yes, but not how you'd think.

Because it's worth noting that immediately after finishing this book, I went out to the nearest bookstore and bought an AI Textbook and a Lisp coding primer. Our Final Invention is a great introduction to real-world AI. And even more than it made me want to try and save the world, it kind of made me want to destroy it. I desperately want to be one of those hundreds of researchers on the cusp of tomorrow. I want to help Artificial Super-Intelligence come into being. I want to ask all the hard questions about consciousness and intelligence. And now I want to consider, and prepare for, the consequences of doing so. If Our Final Invention has done anything, it's made me more conscious of what we're creating. That's why anyone interested in AI, even just in passing, should read Our Final Invention. It gives everyone the knowledge to make their own decisions about AI, and the risks involved. Because, while I'm not saying your Roomba's going to challenge you, someday soon, who knows? It might be able to.