Evidence receipt / belief
Published · transcript-backedShawn Wang: belief
5 Jul 2024 Latent Space The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
“I think. Okay. The last part that makes me uncomfortable about MOE debate is actually it's related to another paper that you wrote about the efficiency misnomer, in the sense that, like, now people are trying to make the debate all about the active parameters rather than total parameters.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 5 Jul 2024
- Publisher
- Latent Space
Transcript context
…think in the IU case, you'll do MOE from scratch, I think. Okay. The last part that makes me uncomfortable about MOE debate is actually it's related to another paper that you wrote about the efficiency misnomer, in the sense that, like, now people are trying to make the debate all about the active parameters rather than total parameters. But it seems like, it sounds like that's something that you're comfortable with, like, flops at inference is, is a relevant metric. And it's, it's not that Well, thanks for, like, actually reading all the, like, reading the papers. You're trying, man. It's very hard to copy. You have a lot of papers. I'm actually very impressed that you're bringing up these papers. Yeah, I'm using attention.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.