Sander Schulhoff: belief

Transcript context

…Okay. How do these companies work with AI products? So say you hire one of these companies to help you increase your adversarial robustness. That's an interesting word to say. How do they work together? What's important there to know? Yeah. How these get found, how do they get implemented at companies. And I think the easiest way of thinking about it is like, I'm a CSO at some company we are a large enterprise. We're looking to implement AI systems. And in fact, we have a number of PMs working to implement AI systems. And I've heard about a lot of the security safety problems with AI. And I'm like, shoot, I don't want our AI systems to be breakable or to hurt us or anything. So I go and I find one of these guardrails companies, these AI security companies. Interestingly, a lot of the AI security companies, actually most of them provide guardrails and automated red teaming in addition to whatever products they have. So I go to one of these and I say, "Hey guys, help me defend my AIs." And they come in and they do kind of a security audit and they go and they apply their automated red teaming systems to the models I'm deploying. And they find, oh, they can get them to output hate speech, they can get them to output disinformation CBRN, all sorts of horrible stuff. And now I'm the CISO and I'm like, "Oh my God, our models are saying that, can you believe this? Our models are saying this stuff? That's ridiculous. What am I going to do?" And the guardrails company is like, "Hey, no worries. We got you. We got these guardrails." Fantastic. And I'm the CISO and I'm like, "Guardrails. Got to have some guardrails." And I go and I buy their guardrails and their guardrails kind of sit in front of and behind my model and watch inputs and flag and reject anything that seems malicious and great. That seems like a pretty good system. I seem pretty secure. And that's how it happens. That's how they get into companies. Okay. This all sounds really great so far. As an idea, there's these problems with LLMs. You can prompt inject them, you can jail break them. Nobody wants this. Nobody wants their AI products to be doing these things. So all these companies have sprung up to help you solve these problems. They automate red teaming, basically run a bunch of prompts against your stuff to find how robust it is, adversarially robust.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.