“The secret of my influence has always been
that it remained secret.”
~ Salvador Dalí
Last month I looked at the short and ignominious career of @TayandYou, Microsoft's attempt to introduce an artificial intelligence agent to the spider's parlor otherwise known as Twitter. Hovering over this event is the larger question of how best to think about human-computer interaction. Drawing on the suggestion of computer scientist and entrepreneur Stephen Wolfram, I put forward the concept of 'purpose' as such a framework. So what was Tay's purpose? Ostensibly, it was to 'learn from humans'. But releasing an AI into the wild leads to unexpected consequences. In Tay's case, interacting with humans was so debilitating that not only could it not achieve its stated purpose, but neither could it achieve its real, unstated goal, which was to create a massive database of marketing preferences of the 18-24 demographic. (As a brief update, Microsoft relaunched Tay and it promptly went into a tailspin of spamming everyone, replying to itself, and other spasmodic behaviors more appropriate to a less-interesting version of Max Headroom).
People have been releasing programs into the digital wild for decades now. The most famous example of the earlier, pre-World Wide Web internet was the so-called Morris worm. In 1988, Robert Tappan Morris, then a graduate student at Cornell University, was trying to estimate the size of the Internet (it's more likely that he was bored). Morris's program would write itself into the operating system of a target computer using known vulnerabilities. It didn't do anything malicious but it did take up valuable memory and processing power. Morris's code also included instructions for replication: specifically, every seventh copy of the worm would instantiate a new copy. More importantly, there was no command-and-control system in place. Once launched, the worm was completely autonomous, with no way to change its behavior. Within hours, the fledgling network of about 100,000 machines had nearly crashed, and it took several days of work for the affected institutions – mostly universities and research institutes – to figure out how to expunge the worm and undo the damage.
