Evidence receipt / belief
Published · transcript-backedSoumith Chintala: belief
6 Mar 2024 Latent Space Open Source AI is AI we can Trust — with Soumith Chintala of Meta AI
“Instead of answering specifically about that Llama 2 situation or whatever, I'll tell you how we think about things.”
Source trail
Everything needed to verify it.
- Speaker
- Soumith Chintala
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 6 Mar 2024
- Publisher
- Latent Space
Transcript context
…Just one question on Llama 2, and then we'll try and fish Llama 3 spoilers out of you. In the Llama 2 paper, the loss curves of the 34 and 70B parameter, they still seem kind of steep. Like they could go lower. How, from an infrastructure level, how do you allocate resources? Could they have just gone longer or were you just, hey, this is all the GPUs that we can burn and let's just move on to Llama 3 and then make that one better? Instead of answering specifically about that Llama 2 situation or whatever, I'll tell you how we think about things. Generally, we're, I mean, Mark really is some numbers, right? So let's cite those things again. All I remember is like 600K GPUs.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.