Evidence receipt / preference
Published · transcript-backedHarrison Chase: preference
6 Sept 2023 Latent Space The Point of LangChain — with Harrison Chase of LangChain
“We still think there's, it's just really application specific. So we prioritized instead, making it easy for people to write custom evaluators and then run them client side and then upload the results so that they can manually inspect them because I think manual inspection is still a pretty big part of evaluation for better or worse.”
Source trail
Everything needed to verify it.
- Speaker
- Harrison Chase
- Attribution
- Verified speaker
- Claim type
- preference
- Recorded
- 6 Sept 2023
- Publisher
- Latent Space
Transcript context
…And then can you create a heuristic once in Langsmith? Like what's like your connection to that? Yeah. So right now, all the evaluation, we actually do client side. And part of this is basically due to the fact that a lot of the evaluation is really application specific. So we thought about having evaluators, you could just click off and run in a server side or something like that. But we still think it's really early on in evaluation. We still think there's, it's just really application specific. So we prioritized instead, making it easy for people to write custom evaluators and then run them client side and then upload the results so that they can manually inspect them because I think manual inspection is still a pretty big part of evaluation for better or worse. We have this sort of components of observability. We have cost, latency, accuracy, and then planning. Is that listed in there?…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.