Chapters (58)
- Copyright Notice
- Dedication
- I Qualia
- Chapter 1
- Chapter 2
- Chapter 3
- Chapter 4
- Chapter 5
- Chapter 6
- Chapter 7
- Chapter 8
- Chapter 9
- Chapter 10
- Chapter 11
- Chapter 12
- II Umwelt
- Chapter 13
- Chapter 14
- Chapter 15
- Chapter 16
- Chapter 17
- Chapter 18
- Chapter 19
- Chapter 20
- Chapter 21
- Chapter 22
- Chapter 23
- Chapter 24
- III Semiosphere
- Chapter 25
- Chapter 26
- Chapter 27
- Chapter 28
- Chapter 29
- Chapter 30
- Chapter 31
- Chapter 32
- Chapter 33
- Chapter 34
- Chapter 35
- Chapter 36
- IV Autopoiesis
- Chapter 37
- Chapter 38
- Chapter 39
- Chapter 40
- Chapter 41
- Chapter 42
- Chapter 43
- Chapter 44
- Chapter 45
- Chapter 46
- Chapter 47
- Chapter 48
- Epilogue
- Acknowledgments
- A Note About the Author
- Newsletter Sign-up
“Yes, guilt. It’s a revenge fantasy. We are so ashamed of what we have done as a species that we have made up a monster to destroy ourselves with. We aren’t afraid it will happen: We hope it will. We long for it. Someone needs to make us pay the price for what we have done. Someone needs to take this planet away from us before we destroy it once and for all. And if the robots don’t rise up, if our creations don’t come to life and take the power we have used so badly for so long away from us, who will? What we fear isn’t that AI will destroy us—we fear it won’t. We fear we will continue to degrade life on this planet until we destroy ourselves. And we will have no one to blame for what we have done but ourselves. So we invent this nonsense about conscious AI.”
“Nonsense?”
“Yes, nonsense. The truth of it is that even with all of our advances, and even when we were trying to create a conscious mind like a human’s, really striving to do it, with all of the technology at hand we thought we needed for the task, we failed.” She leaned back in the chair, waited a beat.
“Failed? But Evrim … all the interviews they gave. Your claims…”
“Yes. Our claims. The interviews. Listen—Evrim is a beautiful machine. A work of art, our highest accomplishment as a species. They are the culmination of thirty years of connectome emulation systems. Evrim has patterns in their mind based on a hundred humans whose connectomes—the web of memory, of body-knowledge of the world, all of it—are distilled into one current entity. Their construction is truly a miracle.”
The interviewer grabbed on to that, interrupting. “Many people do not consider Evrim a miracle. They consider this creature a menace. You’ve spent this interview mocking humankind’s fears about emergent AI—but in the end, isn’t emergent AI exactly what you created? It was your claims to have built the first conscious, self-aware AI that upended everything.”
“No,” Mínervudóttir-Chan said, “in fact, we upended nothing. What we did was to pass the final Turing test. That’s all.”
“I’m not sure I know what you mean.”
“We were looking for the perfect AI for human interaction. We had come close to it with our therapy models, what are popularly called point-fives, but even those have gaps, places where—as we like to put it in the laboratory—‘you can see the strings.’ Most people will never reach that point in a conversation with a point-five, but there are always questions you can ask them that will cause the simulation to fail. We say they are ‘flat.’ Another metaphor.”
“Flat.”