by Malcolm Murray

In forecasting the evolution of AI, we are rapidly losing the middle. The outcomes are diverging to the extent that it no longer makes sense to think about “an average timeline” or “average outcomes”. Many people are now tracking prediction markets for when “AGI” will arrive. The current Metaculus prediction is for July 2032. But nothing will happen in July 2032 specifically. The median is irrelevant. Similarly, the average outcome on the economy from advanced AI might be an increase in GDP growth by 8%. But it is looking much more likely that we will either have unprecedented 15% annual growth or continue on the long-term trajectory of 2%. Averaging across two worlds that cannot exist does not create a realistic world. It is like the old joke of how the average income changes when Bill Gates walks into the bar. The average income might have gone to a billion each, but that does not mean that any one specific person in the bar has one billion.
What matters is the distribution, not point estimates. Toby Ord recently took a step in this direction and discussed using broad timelines for transformative AI (instead of short or long ones), and plan for all potential outcomes across those timelines. We should probably go even further. It might not even be enough to look at one probability distribution for advanced AI, even one that is very bimodal. The outcomes might be distinct enough that we should be looking at several, completely different distributions. When one of the possible worlds includes hitherto-unimaginable characteristics such as the world economy doubling every few years, it has very little in common with other worlds.
World forecasts and object forecasts
This means we should stop looking only at median forecasts, such as the AI 2027 scenario from last year. Its authors have been at pains lately to try to explain that 2027 was the median, not the key prediction. There is no median AGI. What we should do instead is to start forecasting on two distinct levels. First, we need to forecast which world we are in, and only then, conditional on that, we forecast within each world. We can call these world forecasts and object forecasts.
This is something that LEAP does very well. This is a longitudinal AI forecasting study that I am part of. It is run by the Forecasting Research Institute. They often start with positioning different worlds (e.g. slow, medium or rapid AI evolution) and only then, conditional on that being the world we are in, we do forecasts on the relevant characteristics of that world. For example, in a rapid AI evolution world, what share of total income will go to labor vs capital, a hotly debated question. Read more »

Sughra Raza. Esplanade Walks As Days Get Longer. Boston, March 2022.
I recently read about a man who arrived in the United States from India with just thirty dollars in his pocket and, three decades later, had become a billionaire. When asked about the most important lesson of his journey, he answered without hesitation: money matters.

I was 12 years old when I walked down a street in my Bronx neighborhood and saw the poster in the window of Cappie’s. Cappie’s was a certain kind of corner store common in 20th century New York. It sold newspapers and magazines, candy and soda, lotto tickets, cigarettes, and various tchotchkes aimed at kids and teens. Cheap toys, baseball cards, posters, etc. Most of their posters were pinups of the era’s sex pots such as this or that Charlie’s Angels in various states of near nudity. But this poster featured a cartoon mouse, a clear copyright infringement on Walt Disney’s famed vermin. The caption read: Hey, Iran! The mouse held an American flag in one hand. The other flipped the bird.
A couple months ago I wrote that we should not feel blame-worthy if we can’t do all the most courageous things in order to protect our neighbours or help stop a war or try to undermine the entire system. There are less courageous things we can do within our capacity. While that’s true, it doesn’t mean we shouldn’t 
OpenAI released 








Utkarsh Makwana. Detail from ‘Finishing Touches’, 2022. Courtesy: Akara Art.