Evidence receipt / belief
Published · transcript-backedGeorge Hotz: belief
20 Jun 2023 Latent Space Commoditizing the Petaflop — with George Hotz of the tiny corp
“Coming back to what I think is actually gonna happen is, yeah, people are gonna train smaller models for longer and fine-tune them and find all these tricks.”
Source trail
Everything needed to verify it.
- Speaker
- George Hotz
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 20 Jun 2023
- Publisher
- Latent Space
Transcript context
…It must be amazing. It's a trillion parameters. No, it's a little bigger than GPT-3, and they did an eight-way mixture of experts. Like, all right, dude, anyone can spend eight times the money and get that. Coming back to what I think is actually gonna happen is, yeah, people are gonna train smaller models for longer and fine-tune them and find all these tricks. OpenAI used to publish stuff on this, you know, when they would publish stuff…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.