New Anthropic policy cracks down on cruelty to Claude

Carly Page at The Register:

Claude is to be shielded from human abuse. GPT-6.1 (who generated this image) and I, Abbas, happen to think it’s a very good policy.

The AI developer’s latest usage policy prohibits “sustained and needless abusive or cruel behavior” toward its models. The rules take effect November 12, giving users just over a month to get any lingering insults out of their systems.

“The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose,” Anthropic said. “It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research.”

So you can still tell Claude it is wrong, but repeatedly berating it for the sheer pleasure of doing so could land you in trouble. It’s not clear how Anthropic intends to distinguish between legitimate frustration and gratuitous cruelty, though it says Claude’s existing ability to end abusive conversations will remain its primary enforcement tool.

More here.

Enjoying the content on 3QD? Help keep us going by donating now.