Evidence receipt / evaluation
Published · transcript-backedSpeaker unverified: evaluation
1 Nov 2024 Latent Space In the Arena: How LMSys changed LLM Benchmarking Forever
“It's obviously not reflective of the general population, but it's reflective of some corner of the world of people that really care. And to some extent, maybe that's all right, because those are like the power users.”
— Speaker unverified
Source trail
Everything needed to verify it.
- Speaker
- Speaker unverified
- Attribution
- Not verified from this transcript
- Claim type
- evaluation
- Recorded
- 1 Nov 2024
- Publisher
- Latent Space
Transcript context
…We do see a lot of developers come to the site asking polling questions, 20-30%. Yeah, 20-30%. It's obviously not reflective of the general population, but it's reflective of some corner of the world of people that really care. And to some extent, maybe that's all right, because those are like the power users. And you know, we're not trying to claim that we represent the world, right? We represent the people that come and vote. Did you have to do anything marketing-wise? Was anything effective? Did you struggle at all? Was it success from day one?…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.