Lenny Rachitsky: evaluation

Transcript context

…Yeah. I think a lot of the most successful researchers and research leadership at Anthropic are folks who are really strong first principles thinkers about problems. They reason through problems really well, who are just passionate about their research area and have a bold description of what that could look like. And then who are actually close to the details. And so our leadership, our chief scientists, our heads of fine-tuning and RL, folks are actually really close to the training runs and actually look at things like how the training run is going, evals, looking at the underlying data. So actually staying really close and be excited to be in the details, I think have been a sign of really strong researchers and developing taste. And I think another piece is just their ability to think big over time and be very ambitious. Like the Dario, like we can transform software engineering. And I think going in that direction, you learn so much. You have to shoot for the stars in many ways across your ideas, I think, in order to be a successful researcher. I love just this meme of just be more ambitious comes up so often now, which is so hard. It's easy to say that it's hard to actually just like how big can you think, and how that's so much of what AI now unlocks, just be more ambitious. Yeah.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.