Evidence receipt / uncertainty
Published · transcript-backedShawn Wang: uncertainty
5 Jul 2024 Latent Space The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
“I don't know how much, how many evals you want to do, right? Like, I do think Andre Capalti mentioned that.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- uncertainty
- Recorded
- 5 Jul 2024
- Publisher
- Latent Space
Transcript context
…No, we don't. We have like, we work with third party data companies to like, there are a bunch of these like around, right? But like, obviously we don't like eval them ourselves. Like, I don't know how much, how many evals you want to do, right? Like, I do think Andre Capalti mentioned that. Sometimes, like, the best researchers do their own evals. Yeah, looking at the outputs and stuff is something that, like, researchers should do,…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.