Luke Drago: evaluation

Transcript context

…Yeah, We also have perhaps another barrier to automation is judgment in a broader sense and taste. So for example, you can have hundreds of AI models generate whatever you want, whatever piece of writing or imagery you want. But judging what is actually interesting to people is something that's perhaps more difficult to automate. Do you think we might become kind of employed because we have human judgment and because we have taste, or do you think that's ultimately also automatable? So it really depends on the pace and progress of capabilities and exactly what we aim for. I am much more excited about a world where that is a strong, durable human advantage, that diversity of taste. One example here, are you familiar with Nomads and Vagabonds? He's an artist on Twitter. He actually did the art for the intelligence course, did the art for Workshop Labs. My understanding after working with him a bunch is he takes a stable diffusion model and fine tunes it on his own work and the kind of work that he's aiming for. He's gotten very, very good at prompting it. And he produces these absolutely brilliant results. I just cannot get that kind of result out of the model. I don't have the taste for it. I don't know what kind of data should be going in the 1st place. I don't know how to write my prompts like he does. And I'm sure I've worked with him before because obviously we work in the intelligence cursor. And I know he gets hundreds of outputs and yet he releases a very select few. I think that's a fantastic example of someone, how you could use AI to be an exceptional tastemaker. I think his judgment is really exceptional there. It's still his work going in and his work going out. And because of this new medium that he's using, it's been one of the best examples I've seen of an artist fully embracing new technology while still maintaining their own distinct style and taste. And I don't think anyone could look at the art that he's outputting and say it's anyone but his own. And that is one of the things that I'm really excited about moving the technology towards. But I don't think that's the goal of the major companies. Again, this definition that OpenAI uses of AGI is predicated on doing most economically valuable human work. That is a very different game than the, oh, we're going to do some economically valuable work, but it's all going to be tools in your hand that's going to allow you to change and shape the world. That's a different ballgame to do all of it versus to do some of it. And the target right now is total automation. It's a very, very different outcome. Yeah. One barrier to automation that you mentioned in the essay series is local and tacit knowledge. And this will be knowledge that's spread out, that's difficult to formalize in the way that you can train models on it. And it's knowledge that's perhaps shifting constantly. And so it intersects with taste and judgment in a sense. Yeah, is this knowledge and this local and tacit knowledge, is that a way for us to remain relevant?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.