Tim Scarfe: belief

Transcript context

…Yes. So here I was really not talking about any sort of constraint of the computer itself. I was really thinking some abstract way about the algorithm, what the algorithm is doing. And the algorithm is doing some sort of gradient descent flowing down an energy landscape in both cases. And that's where the analogy is. The analogy is not really related to the material aspect of it. It's true that in 1 case it's a material it's and in the other case it's an algorithm. But it is at some levels the same if you think about it correctly. It's so interesting that you're thinking of the constraints as being the algorithm rather than the energy landscape itself. And I get it. I think you're leaning towards there being some kind of a universal learning algorithm. But the way I intuit it is it's almost like the data and the world are more meaningful as constraints. Is that legible? Okay. So I think we will be talking about creativity and then I will also be discussing a lot about constraint, but there will be in my way of thinking in another space. So I started to tell you we are discussing loss landscape and the constraint here was just to feed data. And later on something I'm really interested to discuss is if you think about the world itself, sentences, the data itself, forget about the algorithms that's actually learning it. So data itself is very constrained. All possible sentences are not valid in terms of syntax. So I think thinking of constraint is very useful in both cases but I think of them as very different kind of constraints.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.