Evidence receipt / uncertainty
Published · transcript-backedShawn Wang: uncertainty
5 Jul 2024 Latent Space The 10,000x Yolo Researcher Metagame — with Yi Tay of Reka
“I don't, unfortunately, I don't know enough to push back on this, but on the surface of it, it seems to make sense.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- uncertainty
- Recorded
- 5 Jul 2024
- Publisher
- Latent Space
Transcript context
…and decoder could be beneficial to, like, just using a decoder only model. At the end of the day, the decoder in Encode decoder is a language model. It's still a regular autoregressive language model. So that's actually, I mean, it's not that much different from, like, a retrieval augmented language model. This is news to me. I don't know if you've ever expressed this, but yeah, this actually makes sense. Okay, okay, yeah, yeah, yeah. I don't, unfortunately, I don't know enough to push back on this, but on the surface of it, it seems to make sense. Would you make the same choices if you were not so focused on multimodality? You know, that's one of the ways in which I was thinking, like, Oh, encoder decoder makes sense, then it's more natively multimodal. I just have to say that it's relevant, it's also relevant, yeah, it's relevant, yeah.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.