Tim Scarfe: belief

Transcript context

…Like a big challenge going forward is going to be like how do we change our incentive system for this to actually scale. Right? I think like for example, some amount of economy will be needed or some amount of mechanism design in order to make sure that everyone is still happy to engage in it. Right? So maybe we're gonna have many more leaderboards for whatever is numerically sort of scorable. And I think this this will be really, really interesting to see how sort of compute these automated agents, human shepherding and steering will ultimately sort of change and revolutionize science and, I guess, society more generally. And Rob, looking at the future, we've got a load of people in in San Francisco that that wanna scale language models. And they are adding in implicit forms of adaptivity and composition. So that they're building controllers and they're doing reinforcement learning with verifiable feedback and so on. I think that you subscribe to the slightly different idea that that we need to be far more open ended and we need to be using evolutionary algorithms and so on. But do you think that they are on a path to nowhere? Do you think they might change tack? Do you I mean, where where is this going? So I I actually think that these things can be complementary, right, in the sense like, let's say you fine tune a model to be like a circle packing expert. Right? So I I do believe that mixing in sort of different sort of RL fine tuned models into sort of the ensemble of models and then having a good way to adaptively select which 1 model to use is is not a bad idea. Right? So to me, I just very fully subscribe to this philosophy of open endedness and reading Ken's and Joel's book was really like a fundamental moment in my life. And I want to see how far we can push this. And I think we're we're not yet at sort of convergence where either in the capabilities of the models has converged or the the way how we scaffold around them or the way how we humans interface with them. So to me, they're really like these 3 points, like model capability, model scaffolding, and sort of the user interface. And I think we have a lot still to push on all 3 angles.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.