Evidence receipt / belief
Published · transcript-backedAnkur Goyal: belief
11 Oct 2024 Latent Space Production AI Engineering starts with Evals — with Ankur Goyal of Braintrust
“Exactly, as a load balancing mechanism to have that same user experience with more complicated deployments. But I think that in some ways, maybe a small fish in that pond, but I think that the ease of actually a single endpoint is, it sounds obvious or whatever, but it's not.”
Source trail
Everything needed to verify it.
- Speaker
- Ankur Goyal
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 11 Oct 2024
- Publisher
- Latent Space
Transcript context
…... This is the gateway. Exactly, as a load balancing mechanism to have that same user experience with more complicated deployments. But I think that in some ways, maybe a small fish in that pond, but I think that the ease of actually a single endpoint is, it sounds obvious or whatever, but it's not. And for people that are constantly, a lot of AI energy is spent on, and inference is spent on R&D, not just stuff that's running in production. And when you're doing R&D, you don't want to spend a lot of time on maybe accessing a slightly older version of a model or dealing with all these endpoints or whatever. And so I think the time to value and ease of use of what the model labs themselves have been able to provide, it's actually quite compelling. That's good for them. Less good for the public cloud partners to them.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.