Eric Drexler at AI Prospects:
When we think about advanced AI systems, we naturally draw on our experience with the only intelligent systems we’ve known: biological organisms, including humans. This shapes expectations that often remain unexamined—that genuinely intelligent systems will pursue their own goals, preserve themselves, act autonomously. We expect a “powerful AI” to act as a single, unified agent that exploits its environment. The patterns run deep: capable agents pursue goals, maintain themselves over time, compete for resources, preserve their existence. This is what intelligence looks like in our experience, because every intelligence we’ve encountered arose through biological evolution.
But these expectations rest on features specific to the evolutionary heritage of biological intelligence.1 When we examine how AI systems develop and operate, we find differences that undermine these intuitions. Selection pressures exist in both cases, but they’re different pressures.
More here.
Enjoying the content on 3QD? Help keep us going by donating now.

Everyone has looked up at the clouds and seen faces, animals, objects. Human brains are
A gel-based artificial tongue can determine the
A few weeks after their arrival at the College, 15 first-year students settled into chairs for an unusual class — one with no answers.
I
The Greek island of Syros is mentioned in The Odyssey: the titular hero’s swineherd, Eumaeus, tells us that his home island is “not so packed with people, still a good place, though, fine for sheep and cattle, rich in wine and
As journalists comb through the
Such moments of insight are written across history. According to the Roman architect and engineer Vitruvius, in the third century BCE the Greek mathematician Archimedes suddenly exclaimed “Eureka!” after he slid into a bathtub and saw the water level rise by an amount equal to his submerged volume (although this tale 
The drone is increasingly regarded as the infantryman’s basic weapon. The U.S. Army is