Evidence receipt / preference
Published · transcript-backedKyle Kranen: preference
10 Mar 2026 Latent Space NVIDIA's AI Engineers: Agent Inference at Planetary Scale and "Speed of Light" — Nader Khalil (Brev), Kyle Kranen (Dynamo)
“Yeah. And I’ll, I’ll go back and I have like a little crappy logging software I use and there’s just times where it wants to, like, I’m gonna go deep on research and it’ll, I eat up 80,000 tokens go on another go on another, yeah.”
Source trail
Everything needed to verify it.
- Speaker
- Kyle Kranen
- Attribution
- Verified speaker
- Claim type
- preference
- Recorded
- 10 Mar 2026
- Publisher
- Latent Space
Transcript context
…I did be able feature request. There we go. I actually like a question, like I, I like to like extend and flip over. How much longer do you guys think like agents are gonna be running? Because that’s one thing I’ve been throwing around, like, what happens when, I mean always are it even affects the, like back to the prefilled d the decode, right? Like, yeah. Codex is, I’d say, compared to cloud code, it’s much longer at tasks like, yeah, that thing, we’ll, like to run 6, 7, 8 hours. I’ll run it overnight. Yeah. And I’ll, I’ll go back and I have like a little crappy logging software I use and there’s just times where it wants to, like, I’m gonna go deep on research and it’ll, I eat up 80,000 tokens go on another go on another, yeah. Just eat through tokens and you know, that’s part of it. Like, at the end it does, it does hit a long task. And I think you only see that, that expense. Yeah. I, yeah, there’s insatiable demand for tokens and every improvement that comes kind of just makes our demand even higher. It’s kind of funny, right? Like if you have like a teammate and you ask me to do a task and they’re like, should I save some effort and not think too hard about this task? I’m like, fuck no. I mean, my favorite was like, you can, you can have four shots, right? Yeah. Like the original codex before the app. You, why do one call, like, give it four attempts? Just, just use all the token to out, right? Try Moreal try, try again. Try more. It’s…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.