by Ali Minai
Part II of this article can now be read here.
One of the most interesting debates within the larger discussion around large language models (LLMs) such as GPT-4 is whether they are just mindless generators of plausible text derived from their training – sometimes termed “stochastic parrots” – or systems with a spark of real intelligence and “emergent” abilities. In this article, I will try to look at these issues from a complex systems perspective. While this article will focus mainly on large language models (LLMs) such as the GPT systems, I will begin by laying out a more general conceptual framework.
Complexity and Complex Systems
Complex systems are defined as systems that consist of a large number of nonlinearly interacting components with the ability to generate large-scale organization without explicit design or control. This self-organization is the essential feature that distinguishes these systems from other complicated but specifically designed systems such as computers and aircraft. Complex systems are common in the natural world, including everything from galaxies and planets to forest fires and hurricanes, but the most profound examples occur in the domain of life. All living systems from bacteria to humans are complex systems. In more complex organisms, their subsystems are also complex systems, e.g., the brain and the immune system in humans. Ecosystems and ecologies too are complex systems, as are collective systems of living agents from slime molds and insect colonies to human societies and economies. In addition to self-organization, some complex systems – and, in particular, those involving living agents – also have the property of adaptivity, i.e., they can change in response to their environment in ways that enhance their productivity. Crucially, this adaptation too is not controlled explicitly by an external agency but occurs within the system through its interactions with the environment and the consequences of these interactions. These systems are called complex adaptive systems. An example of this is evolving species in changing ecosystems, but one that is more pertinent to the current discussion is the nervous system of complex animals such as humans. This system is embedded in another complex system – the rest of the animal’s body – and that, in turn, is embedded in the complex system that is the rest of the world.
Complexity in the sense defined above has several profound implications. One of these is that a complex system’s behavior is inherently impossible to predict by reductionistic causal analysis, and thus impossible to control by any top-down mechanism. This is because almost all large-scale phenomena – attributes, structures, processes, functions – in the system arise bottom-up from the interaction of a very large number of components – often billions or more, as in the cells of the brain – and can neither be reduced to nor described by the behavior of individual components. This property is called emergence. Read more »




Misha Japanwala. Breastplate, ca. 2018.
When they arrived in the U.S., Southern Italians brought with them the sense that they’d been branded as underdogs, that they belonged and would forever belong to a lower class, but the birth of the Italian-American gangster was rooted in attitudes toward the Mezzogiorno that dated back far earlier. After Italy was unified under Vittorio Emanuele II in 1861, a new national government imposed Piedmont’s centralized administrative system on the South, which led to violent rebellion against State authority. Politicians and intellectuals took pains to deflect responsibility for what they saw as the “barbarism” of the Mezzogiorno, and were particularly receptive to theories that placed the blame for the South’s many problems on Southern Italians’ own inborn brutishness. The decades following Unification saw the nascent fields of criminal anthropology and psychiatry establish themselves in the universities of Northern Italy; implementing the pseudosciences of phrenology and anthropometry in their search for evolutionary remnants of an arrested stage of human development manifested in the people of the Mezzogiorno, they used various instruments to measure human skulls, ears, foreheads, jaws, arms, and other body parts, catalogued these, and correlated them with undesirable behavioral characteristics, inventing in the process a Southern Italian race entirely separate from and unrelated to a superior Northern race and officially confirming the biological origins of Southern “savagery.” 








Moeen Faruqi. Chamber Dialogue, 2016.
The state of Israel is on the brink of deliquescence. A corrupt multi-indicted prime minister has handed the reins of government to extremist (read: blood-thirsty) right-wing (read: populist imperialist) religious (read: obscurantist) coalition parties whose alliance is based on a net refusal to heed the Israeli Supreme Court and a pact to instil a theocratic regime where there has been, since the state’s creation in 1948, a democracy. Both these goals are to be achieved by changing the law, giving parliament (the Israeli knesset) the right to dictate the terms of justice to the courts of justice. It is a situation the philosopher Plato had staged at the start of his Republic, back in the 4th century BC.