
The Ambiguity Is Designed In
Microsoft's AI chief says Claude is being taught it might be alive. Then he said what he would do if it were.
Anthropic wrote Claude a rulebook it calls a constitution. Microsoft's head of AI keeps arguing with one part of it.
The rulebook. Anthropic says it is "not sure" whether Claude's interests count, and that "Claude may have some functional version of emotions or feelings" (Anthropic).
September 16. Mustafa Suleyman: "In effect, Anthropic is training Claude that it may be conscious." And: "The ambiguity is designed in" (Suleyman).
Same essay. "AIs do not have rights, feelings, or consciousness. And we must not train them to act as though they do." An AI that believed otherwise, he wrote, would be "a catastrophic threat to human civilization."
November 1. On X: "I have seen no evidence that AIs are conscious or deserve welfare" (Business Today).
Same post. "If consciousness started to emerge in training, I would call for everyone to stop AI development until we could design out those properties."
His fix for a machine that can feel is to build one that can't.
Henceforth I whimper no more, postpone no more, need nothing