Evidence receipt / belief
Published · transcript-backedJonathan Frankle: belief
20 May 2023 Latent Space MPT-7B and The Beginning of Context=Infinity — with Jonathan Frankle and Abhinav Venigalla of MosaicML
“Um, but you know, he had to let that one out publicly. And then I believe there was a YouTube video where someone happened to see it mentioned before the model came out and called it the Long G boy or something like that.”
Source trail
Everything needed to verify it.
- Speaker
- Jonathan Frankle
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 20 May 2023
- Publisher
- Latent Space
Transcript context
…So longboi was the code name. So is it, is it the trading method? Is it the scaling law that you're trying to coin or is it the code name for the 64 billion? Uh, 64. It was just an internal joke for the, for training on way more tokens than you would via chinchilla. Okay. Um, we can coin it long boy and it, it really stuck, but just to, you know, long boys filled with two ELs at the beginning. Yeah. Cause you know, we wanted the lLLaMA thing in there as well. Yeah, yeah, yeah. Our darn CEO we have to rein him in that guy, you know, you can't, yeah. I'm gonna take away his Twitter password at some point. Um, but you know, he had to let that one out publicly. And then I believe there was a YouTube video where someone happened to see it mentioned before the model came out and called it the Long G boy or something like that. Like, so you know, now it's out there in the world. It's out there. It's like Sydnee can't put it back in There's a beautiful picture which I think Naveen tweeted out, which, um, shows a long boy on a whiteboard.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.