Alex Pentland at Edge.org:
The first thing you have to ask is what's the magic of the current AI? Where is it wrong and where is it right?
The good magic is that it has something called the credit assignment function. What that lets you do is take stupid neurons, these little linear functions, and figure out, in a big network, which ones are doing the work and encourage them more. It's a way of taking a random bunch of things that are all hooked together in a network and making them smart by giving them feedback about what works and what doesn't. It sounds pretty simple, but it's got some complicated math around it. That's the magic that makes AI work.
The bad part of that is, because those little neurons are stupid, the things that they learn don't generalize very well. If it sees something that it hasn't seen before, or if the world changes a little bit, it's likely to make a horrible mistake. It has absolutely no sense of context. In some ways, it's as far from Wiener's original notion of cybernetics as you can get because it's not contextualized: it's this little idiot savant.
But imagine that you took away these limitations of current AI.
More here.