Maarten Boudry and Simon Friederich at the PhilSci Archive:
Some philosophers and machine learning experts have speculated that superintelligent Artificial Intelligences (AIs), if and when they arrive on the scene, will wrestle away power from humans, with potentially catastrophic consequences. Dan Hendrycks has recently buttressed such worries by arguing that AI systems will undergo evolution by natural selection, which will endow them with instinctive drives for self-preservation, dominance and resource accumulation that are typical of evolved creatures. In this paper, we argue that this argument is not compelling as it stands. Evolutionary processes, as we point out, can be more or less Darwinian along a number of dimensions. Making use of Peter Godfrey-Smith’s framework of Darwinian spaces, we argue that the more evolution is top-down, directed and driven by intelligent agency, the less paradigmatically Darwinian it becomes. We then apply the concept of “domestication” to AI evolution, which, although theoretically satisfying the minimal definition of natural selection, is channeled through the minds of fore-sighted and intelligent agents, based on selection criteria desirable to them (which could be traits like docility, obedience and non-aggression). In the presence of such intelligent planning, it is not clear that selection of AIs, even selection in a competitive and ruthless market environment, will end up favoring “selfish” traits. In the end, however, we do agree with Hendrycks’ conditionally: If superintelligent AIs end up “going feral” and competing in a truly Darwinian fashion, reproducing autonomously and without human supervision, this could pose a grave danger to human societies.
More here.
Enjoying the content on 3QD? Help keep us going by donating now.

F
Sebastian Junger is an award-winning journalist, bestselling author, and previous guest on The Drive. In this episode, Sebastian returns to discuss his latest book,
Scientists generally consider it uncool to anthropomorphize, but as a nonscientist, I can say that if lithium were a friend, it would be the sort of friend who is humble and unassuming and yet also seemingly everywhere all at once doing really fabulous and important things. Lithium, in my imagination, is the envy of the other elements.
Breaking a fast carries more health benefits than the
A myth about Yoko Ono is that she came from nowhere and became a destroyer of worlds. The truth is otherwise. Yoko Ono—now ninety-one—was born in 1933, in Tokyo. Her father was a successful banker and a gifted classical pianist; her mother an art collector and philanthropist. Ono attended a progressive nursery school where the emphasis was on music: the children were taught perfect pitch and encouraged to listen to everyday sounds and translate them into musical notes. In 1943, she and her brother were evacuated to the countryside. Basic provisions were scarce. For hours, they lay on their backs looking at the sky. They said to each other: “Imagine good things to eat. Imagine the war is over.” She returned to Tokyo in 1945. She was president of her high school drama club; in a photo taken at the time, her hair is bobbed and she is wearing what looks like a cashmere sweater set. At Gakushuin University, she was the first female student to major in philosophy. Her family relocated to Scarsdale, in Westchester County; she enrolled in Sarah Lawrence College, where she studied music. After three years, she dropped out and moved to New York, supporting herself by teaching traditional crafts at the Japan Society. In 1960, she rents a loft downtown, at 112 Chambers Street, and begins to host musical performances.
“
In 2021, a driver in Albuquerque, New Mexico, ran a red light, striking and killing a 7-year-old and injuring his father. The suspect fled the scene and eventually escaped to Mexico. Using camera footage and cellphone data, the
We are born; we grow up; we become an adult and perhaps reproduce. Then we might increasingly develop ailments or chronic diseases, before we decline and eventually — inevitably — die. These are the facts of life, at least hitherto, however much many of us might wish for them to be otherwise.