Evidence receipt / belief
Published · transcript-backedShawn Wang: belief
20 May 2023 Latent Space MPT-7B and The Beginning of Context=Infinity — with Jonathan Frankle and Abhinav Venigalla of MosaicML
“There's a beautiful picture which I think Naveen tweeted out, which, um, shows a long boy on a whiteboard.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 20 May 2023
- Publisher
- Latent Space
Transcript context
…Uh, 64. It was just an internal joke for the, for training on way more tokens than you would via chinchilla. Okay. Um, we can coin it long boy and it, it really stuck, but just to, you know, long boys filled with two ELs at the beginning. Yeah. Cause you know, we wanted the lLLaMA thing in there as well. Yeah, yeah, yeah. Our darn CEO we have to rein him in that guy, you know, you can't, yeah. I'm gonna take away his Twitter password at some point. Um, but you know, he had to let that one out publicly. And then I believe there was a YouTube video where someone happened to see it mentioned before the model came out and called it the Long G boy or something like that. Like, so you know, now it's out there in the world. It's out there. It's like Sydnee can't put it back in There's a beautiful picture which I think Naveen tweeted out, which, um, shows a long boy on a whiteboard. That was the origin of Long Boy. In fact, the legs of the lLLaMA were the two Ls and the long boy.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.