Evidence receipt / uncertainty
Published · transcript-backedShawn Wang: uncertainty
29 Sept 2023 Latent Space Building the Foundation Model Ops Platform — with Raza Habib of Humanloop
“Just a technical question on the evals which I don't know if it's too small, but Typically evals involve writing code.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- uncertainty
- Recorded
- 29 Sept 2023
- Publisher
- Latent Space
Transcript context
…Well I'm hoping it's on this evals project that we're launching, right? So we definitely have PMF on the current sort of prompt versioning management stuff. We've got about 10 companies currently in closed beta on evals, giving us a lot of feedback on it. It's a real problem for them. We've seen them get value from it, but we haven't launched it publicly yet, and I'm hoping that will be the next big one. Yeah. Just a technical question on the evals which I don't know if it's too small, but Typically evals involve writing code. Yeah. So it's like Freeform, Python, JavaScript, something like that, for you guys? Yeah, so it's the combination of and again, we're iterating on this, but yeah, yeah, you can define them in Python, And they can also call language models as well.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.