Sander Schulhoff: evaluation

Transcript context

…Okay. So we're going to go on an arc. The next phase of this arc is maybe some good news as a bunch of companies have sprung up to solve this problem. Clearly this is bad. Nobody wants this. People want this solved. All the foundational models care about this and are trying to stop this. AI products want to avoid this like ServiceNow does not want their agents to be updating their database. So a lot of companies spring up to solve these problems. Talk about this industry. Yeah. Yeah. Very interesting industry. And I'll quickly differentiate and separate out the Frontier Labs from the AI security industry because there's the Frontier Labs and some Frontier adjacent companies that are largely focused on research like pretty hardcore AI research. And then there are enterprises, B2B sellers of AI security software. And we're going to focus mostly on that latter part, which I refer to as the AI security industry. And if you look at the market map for this, you see a lot of monitoring and observability tooling. You see a lot of compliance and governance, and I think that stuff is super useful. And then you see a lot of automated AI red teaming and AI guardrails. And I don't feel that these things are quite as useful. Help us understand these two ways of trying to discover these issues, red teaming and then guardrails. What do they mean? How do they work?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.