Evidence receipt / evaluation
Published · transcript-backedSpeaker unverified: evaluation
1 Nov 2024 Latent Space In the Arena: How LMSys changed LLM Benchmarking Forever
“To be clear, none of the leaderboard currently is apples to apples because you have like Gemini Flash, you have, you know, all sorts of tiny models like Lama 8B, like 8B and 405B are not apples to apples.”
— Speaker unverified
Source trail
Everything needed to verify it.
- Speaker
- Speaker unverified
- Attribution
- Not verified from this transcript
- Claim type
- evaluation
- Recorded
- 1 Nov 2024
- Publisher
- Latent Space
Transcript context
…Absolutely. To be clear, none of the leaderboard currently is apples to apples because you have like Gemini Flash, you have, you know, all sorts of tiny models like Lama 8B, like 8B and 405B are not apples to apples. Totally agree. They have different latencies.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.