Book Summaries
Rory Sutherland (What to think about machines that think)
Rory Sutherland considers the possibility that a malign [superintelligence](https://www.amazon.com/gp/product/0198739834/ref=as_li_tl?ie=UTF8&camp=1789&creative=9325&creativeASIN=0198739834&linkCode=as2&tag=unearnedwis05-20&linkId=a53650a4dbb2630d39fda6b68dd4648c) could exist on Earth but is clever
Rory Sutherland considers the possibility that a malign superintelligence could exist on Earth but is clever enough to conceal its presence and intentions. He suggests that humans might not be very adept at recognizing technological threats due to our evolutionary history.
Sutherland points out that throughout evolutionary time, humans primarily faced threats from things roughly the same size as us, such as ferocious animals or other people. We developed instincts to recognize these dangers and minimize the risk of infection, often unconsciously. However, when it comes to threats from advanced technology, our instincts are not well-suited to evaluate them.
He uses the example of driverless cars designed to look cute, like puppies on wheels, to illustrate how technology can exploit our instincts and pareidolia to mitigate our fear. Sutherland raises the question of whether such cuteness is a genuine mental patch to overcome unwarranted fear or a hack to lull us into a false sense of security.
Furthermore, Sutherland asks if there are technologies that have seduced us so effectively that we might only realize their risks when a major problem arises. He highlights our strong belief in “technological providence” and the need to be cautious about embracing new technologies without fully understanding their potential consequences.
Sutherland also proposes the idea of deliberately eschewing certain technologies for periods to maintain technological diversity and keep our mental adaptability sharp. He mentions his suggestion of a weekly “e-mail sabbath” as an example of such deliberate restraint in technology use.
In conclusion, Sutherland emphasizes that the threat of unintended consequences from technology is often more significant than intentionally evil scenarios involving technology. He calls for a thoughtful approach to technological adoption and an awareness of the need to maintain a balance between embracing innovation and safeguarding against unforeseen risks.
YARPP List
Related posts:
- The Veil of Ignorance
- Chapter 17: Death (Genome)
- Mind and Cosmos Summary (8/10)
- The Singularity and The Six Epochs (Part 2)
Keep Reading
Related Articles
Book Summaries
How to Read Karl Marx
Karl Marx was a philosopher, economist, historian, sociologist, political theorist, journalist, and socialist revolutionary.
Book Summaries
Chapter 3: The Power of Parasites (The Red Queen)
[The Red Queen](https://amzn.to/3oisyX4)’s first prophet, Leigh Van Valen, was a devout student of evolution. In 173, he was searching for a phrase to express a new discovery he had made while studying marine fossils.
Book Summaries
Chapter 14: Immortality (Genome)
•The genome is immortal, meaning it can be passed down through generations with no breaks or fatal mistakes. • However, becoming an ancestor is difficult, and natural selection requires it to be difficult.
Book Summaries
Trick or Treatment Summary (7/10)
“Trick or Treatment,” authored by Edzard Ernst, M.D., and Simon Singh, methodically navigates the intricate landscape of alternative medicine, juxtaposing it with the rigor of scientific research and evidence-based practices.