Book Summaries
Rory Sutherland (What to think about machines that think)
Rory Sutherland considers the possibility that a malign [superintelligence](https://www.amazon.com/gp/product/0198739834/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=0198739834&linkCode=as2&tag=unearnedwis05-20&linkId=a53650a4dbb2630d39fda6b68dd4648c) could exist on Earth but is clever
Rory Sutherland considers the possibility that a malign superintelligence could exist on Earth but is clever enough to conceal its presence and intentions. He suggests that humans might not be very adept at recognizing technological threats due to our evolutionary history.
Sutherland points out that throughout evolutionary time, humans primarily faced threats from things roughly the same size as us, such as ferocious animals or other people. We developed instincts to recognize these dangers and minimize the risk of infection, often unconsciously. However, when it comes to threats from advanced technology, our instincts are not well-suited to evaluate them.
He uses the example of driverless cars designed to look cute, like puppies on wheels, to illustrate how technology can exploit our instincts and pareidolia to mitigate our fear. Sutherland raises the question of whether such cuteness is a genuine mental patch to overcome unwarranted fear or a hack to lull us into a false sense of security.
Furthermore, Sutherland asks if there are technologies that have seduced us so effectively that we might only realize their risks when a major problem arises. He highlights our strong belief in “technological providence” and the need to be cautious about embracing new technologies without fully understanding their potential consequences.
Sutherland also proposes the idea of deliberately eschewing certain technologies for periods to maintain technological diversity and keep our mental adaptability sharp. He mentions his suggestion of a weekly “e-mail sabbath” as an example of such deliberate restraint in technology use.
In conclusion, Sutherland emphasizes that the threat of unintended consequences from technology is often more significant than intentionally evil scenarios involving technology. He calls for a thoughtful approach to technological adoption and an awareness of the need to maintain a balance between embracing innovation and safeguarding against unforeseen risks.
YARPP List
Related posts:
- The Veil of Ignorance
- Chapter 17: Death (Genome)
- Mind and Cosmos Summary (8/10)
- The Singularity and The Six Epochs (Part 2)
Keep Reading
Related Articles
Book Summaries
Myth 22: During “Out-of-Body” Experiences, People’s Consciousness Leaves Their Bodies
People have speculated that out-of-body experiences (OBEs) provide conclusive evidence that consciousness can leave the body. Consider the following example of an OBE reported by a woman who had an internal hemorrhage after an operation:. I was awake and aware of my surroundings.
Book Summaries
Hans Halvorson (What to think about machines that think)
Hans Halvorson explores the notion of thinking in the context of computers and humans, emphasizing that thinking machines can process information but lack the capacity for metathought, the ability to think about their own thinking. Key points from his perspective include: 1.
Book Summaries
Apocalypse and Hope (Battling to the End)
In the final three chapters of his book “[Battling to the End](https://amzn.to/4aIoup8),” René Girard engages in a thought-provoking conversation with Benoît Chantre, exploring the intricate relationship between mimetic desire, the escalation of violence, and the role of the Catho
Book Summaries
The Two Ages of War (Battling to the End)
René Girard and Benoît Chantre explore the religious and apocalyptic implications of their dialogue on Clausewitz and modern violence. They begin by considering Péguy’s attempt to oppose a chivalric conception of the duel, rooted in honor, to Clausewitz’s more ruthless vision of war.