Raphael Milliere in Nautilus:
One of the most salient features of our culture is that there is so much bullshit.” These are the opening words of the short book On Bullshit, written by the philosopher Harry Frankfurt. Fifteen years after the publication of this surprise bestseller, the rapid progress of research on artificial intelligence is forcing us to reconsider our conception of bullshit as a hallmark of human speech, with troubling implications. What do philosophical reflections on bullshit have to do with algorithms? As it turns out, quite a lot.
In May this year the company OpenAI, co-founded by Elon Musk in 2015, introduced a new language model called GPT-3 (for “Generative Pre-trained Transformer 3”). It took the tech world by storm. On the surface, GPT-3 is like a supercharged version of the autocomplete feature on your smartphone; it can generate coherent text based on an initial input. But GPT-3’s text-generating abilities go far beyond anything your phone is capable of. It can disambiguate pronouns, translate, infer, analogize, and even perform some forms of common-sense reasoning and arithmetic. It can generate fake news articles that humans can barely detect above chance. Given a definition, it can use a made-up word in a sentence. It can rewrite a paragraph in the style of a famous author. Yes, it can write creative fiction. Or generate code for a program based on a description of its function. It can even answer queries about general knowledge. The list goes on.
GPT-3 is a marvel of engineering due to its breathtaking scale. It contains 175 billion parameters (the weights in the connections between the “neurons” or units of the network) distributed over 96 layers. It produces embeddings in a vector space with 12,288 dimensions. And it was trained on hundreds of billions of words representing a significant subset of the Internet—including the entirety of English Wikipedia, countless books, and a dizzying number of web pages. Training the final model alone is estimated to have cost around $5 million. By all accounts, GPT-3 is a behemoth. Scaling up the size of its network and training data, without fundamental improvements to the years-old architecture, was sufficient to bootstrap the model into unexpectedly remarkable performance on a range of complex tasks, out of the box. Indeed GPT-3 is capable of “few-shot,” and even, in some cases, “zero-shot,” learning, or learning to perform a new task without being given any example of what success looks like.
More here.



Isabella Weber in The Guardian:
Jacob Bacharach in TruthDig:
Astra Taylor in The New Republic:
When Pauline Harmange, a French writer and aspiring novelist, published a treatise on hating men, she expected it to sell at the most a couple of hundred copies among friends and readers of her
“Science fiction is not about the future,” the sci-fi novelist Samuel R. Delany wrote in 1984. The future “is only a writerly convention,” he continued, one that “sets up a rich and complex dialogue with the reader’s here and now.” That is a useful way of understanding all the many pop nonfiction books that speculate about the technologies of the future, and attempt to divine their effects on human beings. Their predictions depend on how well they interpret the present.
There are in
The city of Abbottabad, in the former North-West Frontier Province of Pakistan, was named after James Abbott, a 19th-century British Army officer and player in the “Great Game,” the power struggle in Central Asia between the British and Russian Empires. Today it’s perhaps best known as the garrison town that sheltered Osama bin Laden before he was
Mark Blyth is stumped. He’s the people’s economist who speaks the people’s language through his thick working-class Scottish accent. He hasn’t gone silent in the pandemic ruins of our prosperity. He’s as noisy as ever, but he’s dumbfounded by his adopted people, us American people who can’t see the trouble we’re in. The hardship of the pandemic is real and unfair, he’s saying, and the problem is obvious and deep: that forty million Americans don’t have enough to eat, at the same time our billionaire class, having poisoned our politics, has grown billions richer week by week through the COVID disaster.
Dear H,
Summer always seems to be the cruelest season in the Middle East. The examples include the June 1967 war, Israel’s invasion of Lebanon in 1982, the hijacking of Trans World Airlines Flight 847 in 1985, Saddam Hussein’s invasion of Kuwait in 1990, and the Islamic State’s rampage through Iraq in 2014. The summer of 2020 has already joined that list. But the world should also be attuned to another possibility. Given how widespread bloodshed, despair, hunger, disease, and repression have become, a new—and far darker—chapter for the region is about to begin.
B.B. King, Indianola, Mississippi, 2013—The fat red sun settled against the horizon, throwing a last honey-sweet light across the humid evening and over a small crowd on the lawn beside a railroad track that cut through the cotton fields beyond. A quarter-moon was rising and a chorus of cicadas serenaded the imminent twilight, now joined by the sound of the band; the drummer caught the backbeat and the compere announced: “How about an Indianola hometown welcome for the one and only King of the Blues—B.B. King!”
A novel tells you far more about a writer than an essay, a poem, or even an autobiography,” says Martin Amis. He then adds, “My father thought this, too.” This statement is especially intriguing in light of his soon-to-be-published book,