“I would like to understand things better,
but I don't want to understand them perfectly.”
~ Douglas Hofstadter, Metamagical Themas
A few weeks ago I went to an evening of presentations by startups working in the artificial intelligence field. By far the most interesting was a group that for several years had been quietly working on using AI to create a new compression algorithm for video. While this may seem to be a niche application, their work in fact responds to a pressing need. As demand for video streaming, first in high definition and increasingly in formats such as 4K, hopelessly outruns the buildout of new infrastructure, there is a commensurate need for ever-greater ratios of compression of video data. It is the only viable way to keep up with the reqirements of video streaming, and companies such as Netflix are willing to pay boatloads of cash for the best technologies. But the presentation also crystallized some interesting and important aspects of AI that go well beyond not just niche applications, but the alarmist predictions of people like Steven Hawking, Elon Musk and Bill Gates. What are we really creating here?
This startup, bankrolled by a former currency trader who, as founder and CEO, was the one giving the talk, has engaged in a three-step development program. The first step involved feeding their AI – charmingly named Rita – with every single video compression algorithm already in use, and having it (her?) cherry-pick the best aspects of each. The ensuing Franken-algorithm has already been tested and confirmed to provide lossless compression at a rate of 75%, which is already best in its class. The second step in their program, which is currently in development, charges Rita with the taking the results of everything learned in the first step, and creating its own algorithm. The expectation is that they will reach up to 90% compression, which is really rather extraordinary.
So far, so good. The final step of the program – one which expects to yield a mind-boggling 99% compression ratio – is where things get really interesting. For Rita's creators are now ‘entrusting her' (I know, the more you talk about AI, the more hopeless it is to attempt avoiding anthropomorphization) with the task of creating her own programming language that will be solely dedicated to video compression. There was an appreciative gasp in the room when the CEO outlined this brave next step, and during the Q&A I wanted him to explain more about what this meant.
