Dan Shipper: evaluation

Transcript context

…I like this term, ride the model. So what's like say a new model comes out, what do you think someone say working at, I don't know, Salesforce? Say a PM at Salesforce, what should they do to ride the model? Well, one of the things that's really interesting is a lot of companies handicap their employees from even doing this because I don't know if you can use the latest models at Salesforce. A lot of times you have to wait or it's whatever. So maybe you have to do it in your off time. But the thing that I really like to do with new models is play, and there are certain things where I know it can't quite do it yet, but when a new model comes out, I always turn the rock over again to be like, "Can I do it now?" So it could not do the senior engineer benchmark last time, and I turned the rock over again and now it's at a 60 out of 100, which is really good. So the way to ride the models is not one specific thing because they're always changing, but it is to be curious and playful to apply the model, the new model to whatever it is that you care about, whether that's your job or something outside of your job and to keep turning over rocks because it may not work now, but it may work eventually. It probably will work eventually and the way that you use it matters. So what's really cool is that I think people think of the edge of AI as being in San Francisco, and I actually don't think that that's where it is. I think the edge of AI is wherever AI meets a real human doing something because the people at San Francisco, they're making it, but they don't actually know a lot about how to use it. They don't know, or at least they don't know everything about how to use it. They need to see how other people use it. And so whenever a new model comes out, you get to be one of the first people in the world to discover what it might be useful for. And it's like a new discovery. And I think that's why, for example, we're in Brooklyn, but I really think of us, and I think we are quite far ahead of people in San Francisco because we just use them for everything. And if people do that consistently, I think it's going to be very hard to lose. That is one of the most amazing things about AI right now is no matter how much money you have or a little money you have, you have access to the most advanced AI model. It's not free, so you need some money and you can get it immediately when it comes out. Maybe the only people that have an advantage are the people working at OpenAI or Anthropic, but otherwise it's just available.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.