Evidence receipt / belief
Published · transcript-backedShawn Wang: belief
14 Oct 2023 Latent Space Why AI Agents Don't Work (yet) - with Kanjun Qiu of Imbue
“I think more companies should get into the releasing evals and benchmarks game. Yeah.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 14 Oct 2023
- Publisher
- Latent Space
Transcript context
…And so I think we may release models or we may release tools that we think will help agent builders. Ideally, we would be able to do something like that, but I'm not sure exactly what they look like yet. I think more companies should get into the releasing evals and benchmarks game. Yeah. Something that we have been talking to agent builders about is co-building evals. So we build a lot of our own evals and every agent builder tells me, basically evals are their biggest issue. And so, yeah, we're exploring right now. And if you are building agents, please reach out to me because I would love to, like, figure out how we can be helpful based on what we've seen. Cool.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.