Evidence receipt / belief
Published · transcript-backedLinus Lee: belief
1 Jun 2023 Latent Space Building the AI × UX Scenius — with Linus Lee of Notion AI
“Anthropic recently announced their 100,000 token context model recently. And so I think in the longer term that's going to be taken care of anyway by the models becoming more accommodating of longer contexts.”
Source trail
Everything needed to verify it.
- Speaker
- Linus Lee
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 1 Jun 2023
- Publisher
- Latent Space
Transcript context
…Yeah, but the source doc is. The source doc could be longer. So if you wanted to translate a 5,000 token document, you do have to truncate it. And there is a limitation. It's not something that we are super focused on at the moment for a couple of reasons. I think there are techniques that, if we need to, help us compress those prompts. Things like parameter-efficient fine-tuning. And also the context lengths. It seems like the dominant trend is that context lengths are getting cheaper and longer constantly. Anthropic recently announced their 100,000 token context model recently. And so I think in the longer term that's going to be taken care of anyway by the models becoming more accommodating of longer contexts. And it's more of a temporary limitation. Cool. Shall we talk about the professionalizing of a scene?…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.