Disrupting the Comprehension of Large Language Models: Adversarial Attacks

by David J. Lobina

Anyone for an adversarial suffix?

In previous posts on AI [sic], I have argued that contemporary machine learning models, the dominant approach in AI these days, are not sentient or sapient (there is no intelligence on display, only input-output correlations), do not exhibit any of the main features of human cognition (in particular, no systematicity), and in the instantiation of so-called large language models (LLMs), there is no natural language in sight (that is, the models make no use of actual linguistic properties: no phonology or morphology, no syntax or semantics, never you mind about pragmatics).

The claim about LLMs is of course the most counterintuitive, at least at first, given that a chatbot such as ChatGPT seemingly produces language and appears to react to users’ questions as if it were a linguistic agent. I won’t rerun the arguments as to why this claim shouldn’t be surprising at all; instead, I want to reinforce the very arguments to this effect – namely, that LLMs assign mathematical properties to text data, and thus all they do is track the statistical distribution of these data – by considering so-called adversarial attacks on LLMs, which clearly show that no meaning is part of LLMs, and moreover that these models are open to attacks that are not linguistic in nature. It’s numbers all the way down!

An adversarial attack is a technique that attempts to “fool” neural networks by using a defective input. In particular, an adversarial attack is an imperceptible perturbation to the original sample or input data of a machine learning model with the intention to disrupt its operations. Originally devised with machine vision models in mind, in these cases the technique involves adding a small amount of noise to an image, as in the graphic below for an image of a panda, with the effect that the model misclassifies the image as that of a gibbon, and with an extremely high degree of confidence. The perturbation in this case is so small as to have no effect to the visual system of humans – another reason to believe that none of these machine learning models constitute theories of cognition, by the way – but the perturbation is the kind of mathematical datum that a mathematical model such a machine learning model would indeed be sensitive to (all graphics below come from here). Read more »

An Interview with Robert Pogue Harrison (Part 2 of 2)

by Gus Mitchell

Part 1 of this interview can be found here.

Professor, writer, talk show host, part-time guitarist–Robert Pogue Harrison stands in a category of one among American intellectuals of his generation.

His first book, The Body of Beatrice (1988) a study of the Vita Nuova, lay well within his wheelhouse as a Dante scholar; since then, however, Harrison has charted an increasingly idiosyncratic course as a thinker, a writer, and an educator––in the broadest sense of the word.

Harrison joined the faculty of Stanford in 1986 and became chair of the Department of French and Italian in 2002. He turned 70 this year and announced his retirement. (Andrea Capra’s tribute, part of at a day-long celebration of Harrison’s career at Stanford held on 19th April, was recently republished by 3 Quarks Daily.)

Harrison has written books at a steady clip, each beautifully written and finely wrought, combining intensely felt thought and erudition with quietly challenging daring. His subjects–the forest, the garden, the dead, our obsession with youth–might appear dauntingly bottomless. Yet Harrison’s style, a graceful inter-flowing of literary, philosophical and (increasingly in his recent work) scientific reference-points, gives the impression that one is both ascending and descending, reaching strange giddy heights while delving deep to the essential mysteries at the core of the matter in hand.

It’s the same style that marks the conversations and monologues of his radio show-cum-podcast, Entitled Opinions. I stumbled across an episode of Entitled Opinions sometime in 2020 on the iTunes Podcast app while looking for something about W.H. Auden. But the show has been broadcasting for almost 20 years, “down in the catacombs of KZSU” (Stanford’s local radio station) where, in Harrison’s phrase, “we practice the persecuted religion of thinking.” Read more »

Spring Killing, Redux

by Mike Bendzela

Just two days after petal fall, the plum curculio weevils are already busy.

The week before Memorial Day, I’m back to my old tricks again, poisoning pests in my little orchard. It’s the period after petal fall, when the romance of bloom season gives way to the horrors of war. Commencing in mid-May in Maine, I walk among fruit trees amidst a profusion of blossoms; but by the end of the month, I lie awake at night worrying over a contingent of apple pests — I know I’m going to be busy for a few weeks. I’ve written previously about the trials of raising a species (Malus sieversii) originally from Kazakhstan in the ghastly climate of northern New England. The pests of the northeast — natives such as plum curculio and flatheaded appletree borer, and introduced invaders such as European sawfly and codling moth — have brilliantly adapted themselves to our New World orchards. You have to admire the intrepid little buggers for fulfilling their Darwinian duties so efficiently.

One cannot reach a truce with creatures whose brains are smaller than the tip of a pen. Plant a buffet of fruits that insects like — apples, pears, plums, and peaches — and don’t be surprised if they show up for the feast — in droves. And so, I must strap on a backpack sprayer, or hook a thirty-gallon tank to the back of my riding mower, and start killing. If I want table-quality heritage apples to sell to local markets, I have to resign myself to the equivalent of waging a napalm campaign against my arthropod companions. Does farming have to be like this, even on such a small scale? Must we slaughter our competitors? This question bugs me to no end. Read more »

On the Road: Africa Offshore, Cape Town to the Red Sea

by Bill Murray

A nasty typhoon punished southeast Africa in early 2023. Cyclone Freddy dropped six months of rain in six days, killed 1400 and pounded the poor, overmatched region for thirty-eight long days. From its origins in the Indonesian archipelago, Freddy wound up across the entire breadth of the Indian Ocean before battering the continent, reversing course, then returning to do it again. It was the strongest tropical cyclone ever recorded.

Malawi, Zimbabwe and Mozambique almost never get good press. The modest coverage of last year’s hurricane that struck twice paled alongside coverage of a terror attack in 2021 in the northern Mozambican coastal town of Palma. Survivors recount an utterly harrowing siege, an attack so ferocious that French energy giant Total fled from its $20 billion liquified natural gas investment there, and operations have yet to resume.

Around 200 Black locals and 20 expat contractors found themselves holed up inside the Amarula Palma Hotel. Authorities called in South African private military company Dyck Advisory Group and, as Amnesty International described things,

After the majority of the white contractors and a few well-off Black nationals – among them the Administrator for Palma – were rescued, those left behind attempted to flee by ground convoy but were ambushed by ‘Al-Shabaab.’

This isn’t the better known Al-Shabaab, but rather a local and more rag-tag group loosely affiliated with other Islamic insurgents. Theirs is a shaky, patchwork ideology incorporating local grievances, like Total’s control over local mineral wealth.

Several countries, Angola, Botswana, Rwanda, South Africa maintain a peacekeeping presence in northern Mozambique now and low level fighting is still going on, 36 months later. The poor governance and political instability that give rise to insurgencies like these color the rest of our story. Read more »

Andrea Scrima’s LOOPY LOONIES At Kunsthaus Graz, Museum Joanneum, Austria

by Andrea Scrima

#1: SAYING NO

NO, Andrea Scrima. Graphite on paper, 35 x 35 cm. From the drawing series LOOPY LOONIES

In the talk Judith Butler gave upon receiving the Adorno Prize in 2012, she asks: “Can one lead a good life in a bad life?” Her question springs from a conclusion Theodor W. Adorno formulated in Minima Moralia: “Wrong life cannot be lived rightly” (“Es gibt kein richtiges Leben im falschen”). Years later, he speculated whether modern humans were already too damaged to live in a right world, should such a world ever come into being. Butler nonetheless asks if it’s morally permissible to “wish simply to live a good life in the midst of a bad life,” but concedes that it’s not so simple. It would seem that to pursue the “good” life, one must reject the “bad” life and everything it demands from us. Yet isn’t the term “the good life” already far too tainted by consumerism to be of any real use?

Let’s speak instead of a “true life” as opposed to a “false life.” But what is the nature of this undertaking, and what would the true life entail? The fact that we are interdependent and vulnerable beings presupposes a set of conditions required for even a minimally decent life: food, shelter, clothing, a halfway functioning society, some kind of livelihood. Butler reminds us of Hannah Arendt’s observation that it’s not enough to be alive, to merely survive—that for a life to be considered a life, it has to be lived with meaning and purpose.

Thus, our demand must be not merely for life, but for a liveable life. And yet our lives are not entirely in our hands; they are subject to political and economic structures that rob individuals and entire peoples of their agency and doom them to precarity, and often worse. In Problems of Moral Philosophy, Butler reminds us, Adorno asks “how the broader operations of power and domination enter into, or disrupt, our individual reflections on how best to live.” Read more »

Monday, May 27, 2024

The Frozen Trucker and the Fugitive Slave

by Barry Goldman

The “frozen trucker case” got a fair amount of attention a few years back. At Neil Gorsuch’s Supreme Court confirmation hearing Senator Al Franken hammered him about it. You can watch it here. The facts of the case are these:

Alphonse Maddin was employed as a truck driver by Petitioner TransAm Trucking (“TransAm”). In January 2009, Maddin was transporting cargo through Illinois when the brakes on his trailer froze because of subzero temperatures. After reporting the problem to TransAm and waiting several hours for a repair truck to arrive, Maddin unhitched his truck from the trailer and drove away, leaving the trailer unattended. He was terminated for abandoning the trailer.

Maddin challenged his discharge in a proceeding before an Administrative Law Judge and won. TransAm appealed to the Administrative Review Board, and Maddin won again. TransAm then appealed to the Court of Appeals, which issued its decision in August of 2016, more than seven years after the incident.

The 10th Circuit found in Maddin’s favor, with Gorsuch in dissent. All that is water under the bridge. Today Gorsuch has a life appointment to the Supreme Court, and Franken is back in private life. But it is worth revisiting the case for what it can tell us about legal reasoning and judicial decision making. Read more »

The Large Language Turn: LLMs As A Philosophical Tool

by Jochen Szangolies

The schematic architecture of OpenAI’s GPT models. Image credit: Marxav, CC0, via Wikimedia Commons

There is a widespread feeling that the introduction of the transformer, the technology at the heart of Large Language Models (LLMs) like OpenAI’s various GPT-instances, Meta’s LLaMA or Google’s Gemini, will have a revolutionary impact on our lives not seen since the introduction of the World Wide Web. Transformers may change the way we work (and the kind of work we do), create, and even interact with one another—with each of these coming with visions ranging from the utopian to the apocalyptic.

On the one hand, we might soon outsource large swaths of boring, routine tasks—summarizing large, dry technical documents, writing and checking code for routine tasks. On the other, we might find ourselves out of a job altogether, particularly if that job is mainly focused on text production. Image creation engines allow instantaneous production of increasingly high quality illustrations from a simple description, but plagiarize and threaten the livelihood of artists, designers, and illustrators. Routine interpersonal tasks, such as making appointments or booking travel, might be assigned to virtual assistants, while human interaction gets lost in a mire of unhelpful service chatbots, fake online accounts, and manufactured stories and images.

But besides their social impact, LLMs also represent a unique development that make them highly interesting from a philosophical point of view: for the first time, we have a technology capable of reproducing many feats usually linked to human mental capacities—text production at near-human level, the creation of images or pieces of music, even logical and mathematical reasoning to a certain extent. However, so far, LLMs have mainly served as objects of philosophical inquiry, most notable along the lines of ‘Are they sentient?’ (I don’t think so) and ‘Will they kill us all?’. Here, I want to explore whether, besides being the object of philosophical questions, they also might be able to supply—or suggest—some answers: whether philosophers could use LLMs to elucidate their own field of study.

LLMs are, to many of their uses, what a plane is to flying: the plane achieves the same end as the bird, but by different means. Hence, it provides a testbed for certain assumptions about flight, perhaps bearing them out or refuting them by example. Read more »

Monday Poem

—“For all practical purposes a lie is as true
as the bias of its believer.”
 —Roshi Bob

Plum of a Lie

If I told you a lie
would you believe it?

….. Will it be a true lie? Will it
….. pierce my bias to the bone? Will it
….. meet my need?

Does that matter?

….. As sure as my world is flat, it does.

It would be a help then?

….. I cannot believe without a true lie
….. therefore, please tell me a plum of a lie,
….. gild it, make it sing, craft it so well
….. I’ll not know, have it swell,
….. have its juice challenge the
….. breadth
 of the universe

Shall I then?

….. Please, please—

.Jim Culleny,
3/27/18

Living Your Best Life?

by Martin Butler

The expression ‘Live your best life’ is very much in vogue. It appears more than 3 million times in Instagram posts, which are no doubt full of pictures of smiling attractive 20-somethings completing amazing sporting feats, strolling along glorious beaches or doing exciting things in exotic places. Working 12 shifts delivering parcels for Amazon presumably doesn’t make the grade. As with many other inspirational (or is it aspirational) sayings that pepper the internet, perhaps we should dismiss this expression as just part of the froth produced by internet influencers desperate for our attention. But what does its popularity say about our times? Let’s look beyond the predictable healthy lifestyle stuff and try to actually make sense of it as a philosophical idea. After all, if interpreted generously, it does have a certain philosophical pedigree.

To start with, what does best actually mean? It very much depends on how we view human beings. Regarded in a narrowly hedonic way, where the only things that matter are pleasure and pain, our best life would be one where we avoid as much pain and experience as much pleasure as possible.  This is clearly implausible for many reasons, one being the conclusion of Nozick’s powerful thought experiment: few would regard their best life as being permanently hooked up to an ‘experience machine’ which eliminated pain and provided you with nothing but delightful pleasure. The passive experiencing of pleasure would not be enough. A best life surely requires that we participate in meaningful activities which lead to fulfilment and flourishing, a point which tends to lead to a more individualistic notion. Most people are roughly similar in terms of what they find pleasurable and painful; masochists excepted, human beings tend to find physical injury painful and sweet food pleasant. This is not the case, however, with regards to living a fulfilling life. I personally wouldn’t find a life dedicated to martial arts, rock climbing or running marathons fulfilling, but for many these activities are deeply fulfilling. So is there something distinctively modern about the individualism implicit in living your best life? Read more »

This is Called Freedom

by Rebecca Baumgartner

A little over a year ago, in Allen, Texas, we saw the precise moment when a “good guy with a gun” became a “bad guy with a gun.” It turns out that the line between these two different types of people (and there are only two, we’re told) is as slight as a finger squeezing a trigger. Certainly nothing prior to that trigger-squeeze at the Allen Premium Outlets was illegal. In Texas, as of 2021, someone can legally carry eight guns in public – without a license or permit of any kind. 

Under Texas’ recently expanded “open carry” law, you can take as many guns as you want into a library. You can take as many guns as you want into the state Capitol building in Austin. You can take as many guns as you want with you while walking down the street.

This is called freedom.

It’s a freedom that requires you to accept some logical catch-22s, though. For example, the dividing line between a law-abiding citizen exercising his supposed right to bear arms and a mentally unstable man who should never have had a gun in the first place is only discernible after he has killed people. Once someone becomes a gun-wielding maniac, they retroactively never should have been allowed to have a gun. (It’s a shame they don’t have the courtesy to tell us ahead of time that they’re the bad guys.)

You can get around this conundrum if you believe in a world where people are either all good or all bad, and we can tell the difference. Gun extremists believe in a fairytale world split into dark and light. They would have us believe that it’s just a matter of finding out who falls into which camp. The forces for good get as many guns as they want and are trusted implicitly, and the forces of darkness are (somehow, without legislative intervention) kept from getting guns. And then the good guys with guns keep us safe from the bad guys with guns. Just like in stories.

But notably, and tragically, this is precisely what does not tend to happen during mass shootings in the real world. This is not what happened at the Parkland school shooting or the Orlando nightclub shooting. This is not what happened at Robb Elementary in Uvalde, either. The good guys with guns just stood there, scared out of their minds, while people died. Read more »

Theories of Art and Rachel Cusk

by Derek Neal

An excerpt of Rachel Cusk’s forthcoming novel, Parade, appeared in the Financial Times last week. The story features two narratives, one about a female painter simply referred to as “G,” told in third person, and another about a group of people visiting a farm in the countryside, told in first person plural. It is unclear how these two stories intersect in terms of plot—is G the narrator of the second story? Is she the woman living on the farm?—but these are not questions worth asking. Thematically, the two stories fit together as they both tell of women constrained and controlled by male figures of authority: in this case, their husbands.

Nestled within this narrative is a fascinating articulation of a theory of art, which is what I will focus on in this essay. Cusk does not pause the story to explain this theory, as some purveyors of “autofiction” might do, but embeds it within the story by explaining G’s different artistic periods and the way her art relates to her personal life. The story is stronger because of this.

In the beginning of G’s career, she is seemingly self-taught, lacking formal and technical skill but compensating for it with inspiration and honesty. Her painting is described as existing “autonomously, living in her like some organism that had happened to make its home there.” In this characterization, G is simply the vessel giving shape to an artistic drive she scarcely understands, rather than the source of its creation. Read more »

Pantomime: Not Just For Horses

by Mike O’Brien

This is going to be a broad-strokes, fast-and-loose affair. Or at least loose. In April I wrote a piece about recent work in the field of animal normativity, a quickly developing area of research that is of interest to me for two key reasons: first, it promises to deepen our knowledge of animal cognition and behaviour, allowing us to better attend to their welfare; second, it promises to fill in the genealogical history of our own normative senses, allowing us to better understand the human experience of morality.

Mostly following the cohort of researchers around Kristin Andrews, who are working on de-anthropocentrized taxonomies and conceptual frameworks for studying animal normativity, I noted that one question of particular interest remains outstanding, viz. “do animals have norms about norms?”. Put another way, do animals think about the (innate, and learned) norms governing life in their communities, and do they (consciously or unconsciously) follow higher-order “meta-normative” rules to resolve conflicts between two or more conflicting norms? The answer still seems to be that they do not, at least not among the higher primates who are the principal focus of study for these questions.

One possible explanation for this apparent absence of recursive or reflexive normativity among non-human animals is a lack of language. It is supposed by some that in order to make norms the object of thought, capable of being analyzed, evaluated, compared and synthesized, some system of external representation is needed, and such a system would fit most definitions of a language. If other species possessed such a powerful cognitive tool, we might suppose that they would use it for all kinds of things, not just resolving normative quandaries. And yet we don’t see much evidence for that kind of abstract, propositional communication among other species. Some tantalizing exceptions come to mind, like enculturated apes using sign language and cetacean communication exhibiting structure and complexity that we have yet to fully understand. But as yet there are no examples of bonobo judges or dolphin sages sorting out the immanent logic of their societies’ rules. Read more »

Monday, May 20, 2024

Movement Conservatism In The Funhouse Mirror

by Michael Liss

“Summer Schedule,” July 24, 1947, by Clifford Berryman. U.S. Senate Collection, Center for Legislative Archives.

The optimistic yet somewhat dyspeptic-looking gentleman to your right (quite appropriately to your right) is Ohio Senator Robert A. Taft, a/k/a “Mr. Republican.” Senator Taft was the son of former President and Chief Justice William Howard Taft, a devoted former member of Herbert Hoover’s staff, and an Isolationist who hinted that FDR had encouraged the Japanese to attack Pearl Harbor as a way of inducing America to enter the war against Germany. He was also a fervent proponent of small government and big business, opposed expansion of the New Deal, and in 1947, helped override a Truman veto of the thoroughly anti-Labor Taft-Hartley Act.

In short, Mr. Republican was the real deal. In a 2020 essay for the Heritage Foundation, the conservative historian Lee Edwards wrote:

Before there was Ronald Reagan, there was Barry Goldwater, and before there was Barry Goldwater, there was Senator Robert A. Taft of Ohio. From 1938 until his unexpected death in 1953, Taft led the conservative Republican resistance to liberal Democrats and their big-government philosophy.

The man could have been President. He certainly tried—running for the GOP nomination in 1940, 1948, and 1952—and, although he fell short, he inspired a generation of limited-government conservatives and left his name “Taft Republicans” to posterity. Taft, and Taft Republicans, are a starting point for what is called “Movement Conservatism.”

Beginning in the early 1950s, their ideas were adopted, co-opted, and expanded upon, perhaps most notably by the young William F. Buckley, Jr. and his National Review. Buckley and other Movement Conservatives went beyond issues like small government and anti-Communism. They explicitly rejected Abraham Lincoln’s vision that America was “dedicated to the principle that all men are created equal” and instead insisted that the Founders’ core value was the  protection of private property. The role of government was to get out of the way—except when advancing the interests of the owners of private property.  Read more »

Liberalism for the future

by Jeroen Bouterse

In 2015, political scientist Larry Diamond warned against defeatism in the face of what he called the democratic recession. “It is vital that democrats in the established democracies not lose faith. […] If the current modest recession of democracy spirals into a depression, it will be because those of us in the established democracies were our own worst enemies.” A few years later, as the world’s most powerful democracy had decided to play out that darker option, Diamond wrote with more urgency about how to protect liberal democracy worldwide. In Ill winds, he emphasized the need to provide not only a rejection of alternatives, but a positive vision. “Democracy must demonstrate that it is a just and fair political system that advances humane values and the common good.”

Daniel Chandler places his book Free and Equal (2023) in this same context: for fifteen years in a row, more countries have experienced democratic backsliding than improvement, and the threatened state of democracy worldwide makes it “tempting to go on the defensive”. However, just playing defense is not enough; an ambitious vision for improvement is necessary. “In a moment that calls for creativity and boldness, all too often we find timidity or, worse, scepticism and cynicism”. Chandler believes he has found a recipe for combining the values of liberalism with the spirit of progress and reform.

This combination is crucial. One of the most dangerous narratives taking root in the collective subconscious is that liberalism has had its day; that history is moving on, that liberal democracy belonged to a geopolitical era that is coming to an end, something we tried and that we know the limits of; a system that has already given all it will ever be able to give. Well, not if Chandler has anything to say about it. “There are plenty of exciting and workable ideas about how we could do things differently”, he announces. As our guide to these ideas he has selected John Rawls, and this is quite plainly an excellent decision: Rawls is at the center of 20th-century liberal political thought, but also utopian and principled to an extent that he can hardly be accused of rationalizing an already-existing situation. It makes complete sense to use him as a rallying point for a forward-looking form of liberalism. Read more »