Evidence receipt / observation
Published · transcript-backedSam Altman: observation
18 Mar 2024 Lex Fridman Podcast #419 – Sam Altman: OpenAI, GPT-5, Sora, Board Saga, Elon Musk, Ilya, Power & AGI
“Most people don’t need all the way to 128 most of the time. Although if we dream into the distant future, we’ll have way distant future, we’ll have context length of several billion.”
Source trail
Everything needed to verify it.
- Speaker
- Sam Altman
- Attribution
- Verified speaker
- Claim type
- observation
- Recorded
- 18 Mar 2024
- Publisher
- Lex Fridman Podcast
Transcript context
…How does the context window of going from 8K to 128K tokens compare from GPT-4 to GPT-4 Turbo? Most people don’t need all the way to 128 most of the time. Although if we dream into the distant future, we’ll have way distant future, we’ll have context length of several billion. You will feed in all of your information, all of your history over time and it’ll just get to know you better and better and that’ll be great. For now, the way people use these models, they’re not doing that. People sometimes post in a paper or a significant fraction of a code repository, whatever, but most usage of the models is not using the long context most of the time. I like that this is your “I have a dream” speech. One day you’ll be judged by the full context of your character or of your whole lifetime. That’s interesting. So that’s part of the expansion that you’re hoping for, is a greater and greater context.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.