Brendan Foody: prediction

Transcript context

…We're entering the era of evals. We started working with all of the top AI labs. What the labs need is a labor marketplace. They actually need extraordinary professionals that can measure model capabilities. You found this pocket maybe the biggest business opportunity in history. grew from one to 400 million in revenue run rate in 16 months. Fastest ascent in history. Why is this so valuable? The market is bound by the amount of things where humans can do something that models can't. The lab's primary bottleneck to improve models is how they can effectively have some way of measuring what success looks like for the model. There's this tweet that you retweeted. If you really think about it, we were put on Earth to create reinforcement learning training data for labs.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.