Evidence receipt / belief
Published · transcript-backedJosh Albrecht: belief
25 Jun 2024 Latent Space State of the Art: Training >70B LLMs on 10,000 H100 clusters
“I think you can spend a lot of time getting really good at these kinds of benchmarks without making, like, kind of more general purpose progress.”
Source trail
Everything needed to verify it.
- Speaker
- Josh Albrecht
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 25 Jun 2024
- Publisher
- Latent Space
Transcript context
…Yeah, but, you know, I think it's not really... I think you can spend a lot of time getting really good at these kinds of benchmarks without making, like, kind of more general purpose progress. And so I think we're a little bit leery of going too far in that direction. Similarly, like, coding competitions. Like, we do a lot of code generation, but we don't really do a lot on, like, code competition problems for the very, very hard ones. So I think you can go…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.