Evidence receipt / belief
Published · transcript-backedAlex Volkov: belief
8 Nov 2023 Latent Space AGI is Being Achieved Incrementally (OpenAI DevDay w/ Simon Willison, Alex Volkov, Jim Fan, Raza Habib, Shreya Rajpal, Rahul Ligma, et al)
“If you hit the API, get the whole thread back, then count the tokens. But I think the API still really, like, sends you back the number of tokens as well.”
Source trail
Everything needed to verify it.
- Speaker
- Alex Volkov
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 8 Nov 2023
- Publisher
- Latent Space
Transcript context
…the API, does the API at least tell you how many tokens you used? Or is it entirely up to you to do the accounting? Because that would be a real pain if you have to account for everything. So in my head, the question I was asking is, like, If you want to know in advance API, Like with the library token. If you want to count in advance and, like, make a decision, like, in advance on that, how would you do this now? And they said, well, yeah, there's a way. If you hit the API, get the whole thread back, then count the tokens. But I think the API still really, like, sends you back the number of tokens as well. Isn't there a feature of this new API where they actually do, they claim it has, like, does it have infinite length threads because it's doing some form of condensation or summarization of your previous conversation for you? I heard that from somewhere, but I haven't confirmed it yet.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.