01 / preference
I mean, I think, I think for hallucinations specifically, there are a bunch of different things that you might care about reasonably, and that you’d measure quite differently, like we’ve called this a amnesty and solutionation rate, not trying to declare the, like, it’s humanity’s last hallucination.
“I mean, I think, I think for hallucinations specifically, there are a bunch of different things that you might care about reasonably, and that you’d measure quite differently, like we’ve called this a amnesty and solutionation rate, not trying to declare the, like, it’s humanity’s last hallucination.”
- Speaker
- Micah-Hill Smith
- Episode
- Artificial Analysis: Independent LLM Evals as a Service — with George Cameron and Micah-Hill Smith
- Publisher
- Latent Space