Anthropic has been consulting theologians and ethicists on Claude’s behavior, raising questions about who gets to shape a chatbot’s values

Chris Stokel-Walker at Scientific American:

In late March around 15 religious thinkers met with the artificial intelligence company Anthropic to discuss one of the strangest and most consequential questions now facing the AI industry: How do you teach a chatbot to be good?

The invitations to these meetings had arrived in different ways. Greg Cootsona’s came via e-mail. Brian Patrick Green’s came via a friend of a friend after Anthropic asked for suggested names. Both ended up in a series of conversations with the company about Claude, Anthropic’s chatbot, and the moral framework meant to guide how it behaves.

The aim wasn’t to make the chatbot Bible-thumping or pious. But it was an acknowledgment that centuries-old traditions of moral reasoning might offer insights to a five-year-old frontier AI lab whose systems are becoming more capable, more persuasive and harder to govern by simple rules.

More here.

Enjoying the content on 3QD? Help keep us going by donating now.