by Dwight Furrow
The question of whether AI is capable of having conscious experiences is not an abstract philosophical debate. It has real consequences and getting the wrong answer is dangerous. If AI is conscious then we will experience substantial pressure to confer human and individual rights on AI entities, especially if they report experiencing pain or suffering. If AI is not conscious and thus cannot experience pain and suffering, that pressure will be relieved at least up to a point.
It strikes me as extraordinarily dangerous to give super-human intelligence the robust autonomy entailed by human rights. On the other hand, if we deny such rights to AI and it turns out to be conscious, we incur the substantial moral risk of treating a conscious being as a labor-saving device. A fully sentient, super-human intelligence poorly treated will not be happy.
I hear and read a good deal of discussion coming out of Silicon Valley about whether AI is at least potentially conscious. The problem is that—and I mean this quite literally—no one knows what they’re talking about. Because no one knows what consciousness is. This is an enormously complex question with a very long history of debate in philosophy and the sciences. And we are not close to resolving it. There are at least eight main theories of consciousness and countless others striving to get attention. We are unlikely to settle this question quickly so it’s important not to make unwarranted assumptions about such a consequential issue.
This is not the place to articulate all the nuances of that debate and its implications for AI, but I think there is a way of bringing some focus to the question by organizing these various theories as competing views on the status of subjective experience, or to use the more or less technical term, the status of “qualia.” Read more »








In 

The only thing worse than a good argument contrary to a conviction you hold is a bad argument in its favor. Overcoming a good argument can strengthen your position, while failing to may prompt you to reevaluate it. In either case, you’ve learned something—if perhaps at the expense of a cherished belief.





