Nathan Labenz: belief

Transcript context

…Yep. Yeah. Like in the example of Anthropic and OpenAI for OpenAI, they have a very simple caching API, which is basically like, they'll just cache any prefix for 24 hours and they do it automatically. Anthropic has a much more explicit caching API and you can only cache four points in your. in your call and there's a lot more code kind of making it happen. So in this case, we're kind of lucky in that like once you've done the work to make Anthropic work, making OpenAI work is pretty easy. But yeah, in that case, we do have different code to sort of translate our context to like a cacheable context in each case. Other, so you mentioned, I think five providers, Anthropic, OpenAI, Gemini, Deepseek, and Kimmy. Not on that list were Grok, whatever the new meta models are called, and GLM or Minimax. Like, are there any other, how are you kind of, where are you drawing the line? How are you thinking about who's in and who's out? It is so hard to stay up to date on this stuff. We have the ability internally to test models pretty quickly. It's harder to actually ship things in production because, for example, the way thinking blocks work is different across different providers. And if you have bugs, you might just tune the prompts and things. So we haven't shipped that many, but we've tested GLM internally. We've tested the Google models, Kimi, DeepSeek, probably some others I'm not thinking of. I think right now, and most of this is initially vibes, right? You go in there and you play around with it and you're like, Is this close enough to the frontier that we want to put some effort in here? And usually the answer is no. And I think the ones that we've, like Kimi, DeepSeek, and Google, and plus obviously OpenAI are the ones where like, Okay, actually this is pretty close to the frontier, so it's worth doing. But there'll probably be others in that list. I have not been paying a huge amount of attention to Grok. Maybe I should be paying more attention to them. I don't hear a lot of other developers using their models, but they sure seem to be investing a lot. So I don't know, maybe that'll change.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.