by Brooks Riley

by Rafaël Newman

My father’s mother—Annie Newman, my grandmother or Bubbi—was born Hannah Dubin in a shtetl in what is now Ukraine a few years before the Great War. One of her earliest recollections—in addition to the image of her own grandmother hiding in a baby carriage to escape marauding Cossacks—was of being able to see troop movements from the roof of her house, presumably during the Russian Imperial Army’s advance against Austria-Hungary, an engagement that occurred in Galicia, farther to the west, in 1914. Much later, in the aftermath of the nuclear accident in Chernobyl in 1986, when that obscure place was suddenly on everyone’s lips, she began recalling that her village, which she called Priut, in a region she referred to by its Russian name as Екатеринославская губернія, or Yekaterinoslavskaya guberniya—the Yekaterinoslav Governorate, a province of the Russian Empire—was not far from that site, which had now become infamous for a catastrophic meltdown. Read more »

My wife walking in the woods near Franzensfeste, South Tyrol.

by Bill Murray

In the typical American city where we live, the average commute time is 78 minutes a day and 97.5% of these poll respondents agree traffic congestion is a serious problem. The last place you might expect to find people who commiserate is an island forty miles long and thirty wide, 420 miles east of Madagascar in the Indian ocean. But here we are.

We came to poke around some of the more outre bits of Overseas France, La France d’outre–mer. Welcome to the French département of Réunion Island, eighteen hundred miles from Johannesburg and 3275 crow-fly miles south of India in the southern Indian Ocean. It doesn’t sound very French, but it is, resolutely, and likes it that way.

It’s about a four hour flight out here from Johannesburg, the only continental African connection. You leave late at night, think you can sleep a little bit but these aren’t long haul planes, so you do your best in a tilt-back seat. They do a quaint thing, they still run a food cart down the aisle handing out newspapers, like in the old days.

Time zones work to smooth out flight schedules, not sleeping schemes, so as you arrive, if you squint while you’re still way up in the air you can just discern that dawn, somewhere over the Andamans and Nicobars, is screaming around the planet, about to catch you.

And now that we’re here, we can’t get out of town. People are just crazy, crazy busy, but where is it they’re so busy getting off to? Réunion’s economic engine is sugarcane and its main exports are sugar, rum and molasses. Read more »

by Ali Minai

But nature is a stranger yet:
The ones that cite her most
Have never passed her haunted house,
Nor simplified her ghost.

—Emily Dickinson, “What Mystery Pervades a Well”

The first article of this 2-part series laid out the idea of emergence in complex systems, discussed how the appearance of abilities such as the generation of grammatical, syntactically correct, and meaningful text can reasonably be seen as an example of emergence, but also why these emergent abilities are just a shadow – or ghost – of the deeper language generation process in humans. This second part gets more deeply into the last point, making a detailed argument for why the linguistic abilities of LLMs should be seen as limited, and what would be needed to extend them.

The Meaning of Meaning

Perhaps the most critical difference between an LLM’s model of language and that of a human is in the way meanings are understood in the two. The task on which LLMs are trained provides no explicit information about meanings, and depends only on knowing the structural relationships between words in text. However, the fact that LLMs almost always use words in meaningful ways indicates that they have an implicit model of meanings too. What is the nature of that? The answer lies almost certainly in a linguistic idea called the distributional hypothesis of meaning, which says that the meaning of a word can be inferred from the statistics of its use in the context of other words. As described above, LLMs based on transformers are pre-disposed to the statistical learning of structural relationships in text, and their representations of meaning must be derived implicitly from this because of the tight linkage between word usage and meaning per the distributional hypothesis. Given enough data, the statistics can become very accurate – hence the meaningful output of GPT-4 et al. But such meanings – though accurate for purposes to usage – are abstractions. In contrast, the meanings in the human mind are grounded in experience. GPT-4 might understand the meaning of the word “burn” as something associated with the words, “fire”, “heat”, “flame”, “smoke”, “pain”, etc., but a person understands it in terms of the sensation of feeling heat and getting burned. Similarly, GPT-4 may use the words “near” and “far” correctly, but it has no experience of an object being near enough to touch or too far away to recognize. Concrete meanings in the human mind are thus grounded in the fact of the human animal being embodied – a physical system with sensations and the capability of action that leads to physical consequences. The LLM is “all talk” – just simulating concrete meanings as ungrounded symbols. Of course, not all concepts in human language are concrete enough to be defined in direct experiential terms, and there is ongoing debate about how the mind grounds abstract meanings. However, it seems plausible that they are grounded in the substrate of more concrete meanings, and thus indirectly in experience as well (see reference [1] for a recent overview, reference [2] for my views in detail). It is in this sense above all that LLM models are ghosts in the machine. Read more »

by Tim Sommers

I’m not really interested in magic. But I am interested in crime. So, recently while reading a discussion of close-in magic by neuroscientists I perked up when they got to the question of how criminals, and others of questionable character (like magicians), steal wristwatches right off their victims’ wrist without being detected. (Still relevant? Wrist watch wearing, admittedly, is way down from its peak in the 1950s, but a third of adult males still wear one every day – and then there’s smartwatches, step counters, etc.)

Apparently, there’s a skill and a trick involved in stealing a watch. The skill is to learn to undo the clasp using just your middle and pointer fingers, while simultaneously shaking hands with someone. Sure, that’s quite a skill to master, but I was more curious about how you then yank a watch off someone’s wrist without them noticing – particularly a watch with a “deployant clasp” that doesn’t open all the way. (See image above.)

Here’s what you do. You just clap the person on the shoulder at the same moment you yank off the watch. Apparently, this works. It’s all about distraction. Magicians have a fancy word for distraction. They call it “misdirection.” Personally, I find this irritating. I’ll stick with distraction.

Here’s another example of distraction from a magician. Before the start of a magic show I was dragged to, the audience was encouraged to come on stage and examine this large container to make sure it was real, solid, and had no trap door or hidden egress. Right before the show started the container was turned around by assistants, then closed. When the show opened, the container was turned back around, opened, and the magician stepped out to thunderous applause.

The crazy part is how the trick works. Having the audience check it out ahead of time was just a distraction. When they turned the container around, before they closed the door, the magician strolled casually out of the wings and climbed inside in full-view of the audience. I saw it clearly because I knew it was going to happen (because I had read a book the magician had written). But shouldn’t everyone have seen it? (Don’t even get me started on the “Invisible Gorilla.”)

Which brings me to my old roommate Nick. Read more »

by Steven Gimbel and Gwydion Suilebhan

Whether you love, hate, or tolerate Tesla may say something about the era you grew up in.

Every generation, when it reaches a certain age, makes two proclamations: Saturday Night Live used to be funnier, and “kids these days” are lazy and stupid.

Neither claim is true, of course, but they feel true. We members of Generation X insist SNL isn’t as good as it was, but that’s because they aren’t making jokes for us any more. Their audience now consists largely of Millennials, who have a unique sense of humor shaped by the age in which they were raised. That younger audience isn’t either lazy or stupid, either. Millennials work hard, but in different ways, and they know different things than we do as well.

Still, there are meaningful differences between Gen Xers and Millennials, and one of those differences has become particularly stark of late: our tolerance for moral ambiguity.

As Gen Xers, we grew up in a world in which our favorite sports heroes were discovered taking steroids, and we had to figure out how to keep rooting for them anyway. A world in which bona fide heroes like Senators John Glenn and John McCain could get caught up in a major political scandal and still get re-elected. A world in which our own idealistic (and idealized) Baby Boomer parents entered their peak earning years and started voting for tax cuts instead of justice. We learned to distrust everything and everyone: even those we loved.

We also learned to hold multiple conflicting opinions at the same time. We need more people of color on the Supreme Court AND Clarence Thomas harassed Anita Hill AND the accusations against him played into racist tropes about Black men. Bill Clinton abused his power in having a tryst with Monica Lewinksy AND we shouldn’t portray Lewinsky as a powerless pawn unable to make her own choices AND Clinton’s politics were generally favorable to women AND he was prosecuted by other White men who were equally (or more greatly) compromised.

Life taught us to doubt the existence of pure “good” and “bad.” We came of age in a morally ambiguous world. Millennials, by contrast, came of age in a morally bankrupt world. Read more »

by Brooks Riley

by Eric Bies

I think of Pearl S. Buck and end up thinking of William F. Buckley. I think of The Good Earth—of hovels unworthy of Frankenstein’s monster and a palace sacked in smoke, its shriveled matriarch glued to an opium pipe—and end up thinking of Firing Line. Clicking over to YouTube, typing, hitting enter, clicking, watching: after the FBI Warning about unauthorized reproduction and so forth, past the Hoover Institution’s little slide about same, through the twittery culture-conferring bit of Bach as theme, this is number 267, an interview with Jorge Luis Borges. I giggle a little as South America’s Titan, gazing literally blindly out past everyone in attendance that day in Buenos Aires, clips and interrupts Buckley’s stately introduction, an introduction that begins with Buckley reading off words about Borges, by Borges.

Buckley: About himself he said recently, “As for a message, well, I have no message. Some things—”

Borges: That’s right, there’s no message whatever.

Buckley [places a hand on Borges’ arm]: “Some things simply occur to me and I write them down with no aim to hurt anyone or to convert anyone. This is all I can say. I make this public confession of my poverty before everybody—”

Borges: Yes.

Buckley: “Besides, had I not done so, you would have known—”

Borges: But I think you may know.

Buckley: “—you would have known it was true,” yes that’s what I said.

Borges: Yes.

Buckley: I’m just going to finish this introduction, and then we’ll exchange—

Borges: That’s right, yes, that’s right.

Buckley: Uh, about him others—

Borges: [inarticulate]

Buckley: About him others have written that he is the greatest living writer. Still others, that he has influenced the literature of the world more than anyone alive. Jorges Luis Borges lives here in Buenos Aires, although he has traveled extensively, especially in the United States, and taught most recently at Harvard for a year. He is blind, since the late fifties. He does not mind it, he says [Buckley’s brows go up], because now he can live his dreams with less distraction—

Me: CLICK.

Video paused, I get up from my desk, traverse the kitchenette, use the toilet, and refill my glass with water from the tap. My apartment isn’t bugged or anything, but if it were, say, with a dozen little cameras, or even if the little man in my phone were to tune in for a peep to help pass the afternoon, dangling his eye from the eye of my phone which I carry from point to point before returning to my desk—nothing would appear awry. On the surface, I, the walls, even the water in this glass remain totally unperturbed. But, for seventy seconds or so, those last few pre-pause words, far from the conclusion of Buckley’s introduction, have been shimmering brightly inside of me. Read more »

by David Introcaso

In late March the United Nations adopted a landmark resolution requesting an advisory opinion from the International Court of Justice “on the obligations of States in respect of climate change.”  Specifically, the resolution seeks an opinion regarding legal consequences under international law states may face for acts or omissions that have caused significant damage to the climate that in turn harm other states.  The US opposed the resolution arguing disingenuously diplomatic efforts constitute the best approach to addressing the climate crisis.  Disingenuous in that the US, for example, is the only country not to sign the UN’s 1992 Convention on Biological Diversity.  Also in late March the European Court of Human Rights heard two lawsuits brought by French and Swiss citizens who argued their governments had violated their human rights by failing to address the climate crisis.  In the fall the European Court will hear a related case brought by Portuguese citizens that names all 27 European Union and five other nations as defendants.

Because annual global greenhouse gas emissions (GHG) continue to increase and because there is no credible pathway to limiting global warming to an average of 1.5C, not surprisingly the number of climate crisis-related lawsuits have rapidly increased since 2020.  Of the 2,000 globally 500 are in the US.  The most noted US lawsuit is Juliana v the US, a case that has been termed the most important in history largely because the US is responsible for 40% of excess global GHG emissions.  In 2015, 21 youth plaintiffs, moreover minorities as young as eight, filed a lawsuit against President Obama and seven executive departments including Agriculture, Commerce, Energy and the Department of Defense, the world’s largest institutional GHG polluter.  The Department of Health and Human Services (HHS) was not named despite the fact the healthcare industry, extensively regulated and almost entirely financed or subsidized by the federal government, emits four times more GHG emissions than the US defense department.  The plaintiffs allege the federal government has violated, in part, their constitutional due process rights by supporting the use of fossil fuels for over fifty years.  The government does this, the plaintiffs argue, despite knowing resulting GHG emissions endanger the climate’s stability thereby compromising the plaintiffs’ health and the health of all future Americans.  The plaintiffs requested the court to order the government to implement a plan to phase out fossil fuel use and draw down excess atmospheric GHG emissions. Read more »

Dandelions in an alpine field at Spiluck, South Tyrol.

by Ethan Seavey

On the night that I first told someone else that I was gay, the world was held together with a single phrase which was echoed from speaker to listener and back again. My friend and I were both queer but I was the first one saying it. So for us, it was healing to say and to hear: “It doesn’t mean anything. I (or you) won’t let it define me (or you).” We repeated this wish, that someone’s sexuality could be considered separate from their social identity. I decided to trust that I could be gay, but not this or that kind of gay, just myself. I used the phrase like a prayer and begged that I could exist in a straight-minded Catholic world. It worked for a few months. Then I started to tell more people. Two more friends and then my parents. Siblings and more friends. And finally, everyone. Most everyone was kind and most everyone said it didn’t change a thing. But it changed many things. I finally accepted that I was the Queer.

The Queer is a lonely identity. They are raised believing that they are and can be the same as everyone else, but as they grow up, they realize that they are The Queer in a space that is not made for them. They are The Only Queer in a class of three hundred, but they heard there’s another Queer in the grade above. They don’t speak to one another because they are afraid to be seen associating. They realize that they will never have the lives of their parents.

The Queer must reckon with the close-minded Gods that dominate the globe. They are born into a world that is not made for them and given an identity that defines them forever. This world is ruled by a strong God in the clouds who supports the structure that hurts them. With tall walls He puts each person in a room and investigates them. He studies the outliers; not to know them, but to find out ways to make them fit in. Read more »

by Ashutosh Jogalekar

This is the first of a series of short pieces on J. Robert Oppenheimer. The others can all be found here. Popular interest in Oppenheimer’s life seems to have peaked this year with the upcoming release of Christopher Nolan’s mainstream film, “Oppenheimer”. Several books about Oppenheimer – and even a popular opera – have come out just in the last two decades. Analogies between Oppenheimer and nuclear weapons and new technologies like AI and gene editing are frequently drawn, sometimes incisively and often misleadingly. Why does this man continue to inspire so much interest? And why now?

My goal is to provide readers who might not want to read a full biography of Oppenheimer with some of the highlights of his life that address these questions and put them in context. Needless to say, this series – which is essentially chronological – is not supposed to be an exhaustive biography and is biased by what I personally think was most interesting about this brilliant, fascinating, complicated man’s life and times.

The physicist Isidor Rabi – a friend who perhaps knew Robert Oppenheimer better than he knew himself – once said that Oppenheimer was a man composed of many shining splinters. That succinct assessment captures the central dilemma of Oppenheimer’s life: identity. It was a dilemma that made him who he was and one that contributed to the myriad problems he faced in his life. I also believe that it was this dilemma that makes him a fascinating man of enduring interest, more interest than many of his contemporaries who were far better-known scientists.

To understand this dilemma it’s worth starting, as it often is, with Oppenheimer’s childhood. The affluent household where Oppenheimer was born and grew up was, in the words of a biographer, “like Ibsen’s Rosmersholm, that aristocratic estate where voices and passions were always subdued, and where children never cried – and when they grew up never laughed.” Read more »

by Ali Minai

Part II of this article can now be read here.

One of the most interesting debates within the larger discussion around large language models (LLMs) such as GPT-4 is whether they are just mindless generators of plausible text derived from their training – sometimes termed “stochastic parrots” – or systems with a spark of real intelligence and “emergent” abilities. In this article, I will try to look at these issues from a complex systems perspective. While this article will focus mainly on large language models (LLMs) such as the GPT systems, I will begin by laying out a more general conceptual framework.

Complexity and Complex Systems

Complex systems are defined as systems that consist of a large number of nonlinearly interacting components with the ability to generate large-scale organization without explicit design or control. This self-organization is the essential feature that distinguishes these systems from other complicated but specifically designed systems such as computers and aircraft. Complex systems are common in the natural world, including everything from galaxies and planets to forest fires and hurricanes, but the most profound examples occur in the domain of life. All living systems from bacteria to humans are complex systems. In more complex organisms, their subsystems are also complex systems, e.g., the brain and the immune system in humans. Ecosystems and ecologies too are complex systems, as are collective systems of living agents from slime molds and insect colonies to human societies and economies. In addition to self-organization, some complex systems – and, in particular, those involving living agents – also have the property of adaptivity, i.e., they can change in response to their environment in ways that enhance their productivity. Crucially, this adaptation too is not controlled explicitly by an external agency but occurs within the system through its interactions with the environment and the consequences of these interactions. These systems are called complex adaptive systems. An example of this is evolving species in changing ecosystems, but one that is more pertinent to the current discussion is the nervous system of complex animals such as humans. This system is embedded in another complex system – the rest of the animal’s body – and that, in turn, is embedded in the complex system that is the rest of the world.

Complexity in the sense defined above has several profound implications. One of these is that a complex system’s behavior is inherently impossible to predict by reductionistic causal analysis, and thus impossible to control by any top-down mechanism. This is because almost all large-scale phenomena – attributes, structures, processes, functions – in the system arise bottom-up from the interaction of a very large number of components – often billions or more, as in the cells of the brain – and can neither be reduced to nor described by the behavior of individual components. This property is called emergence. Read more »