Evidence receipt / evaluation
Published · transcript-backedHamel Husain: evaluation
25 Sept 2025 Lenny's Podcast Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar (creators of the #1 eval course)
“" I'm like, "Yeah, let's look at it right now." They're surprised that I am going to go look at individual traces, and it always 100% of the time learn a lot and figure out what the problem is.”
Source trail
Everything needed to verify it.
- Speaker
- Hamel Husain
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 25 Sept 2025
- Publisher
- Lenny's Podcast
Transcript context
…Shoot, many humans are still great. I think that's great news. The second one that I see a lot is, "Hey, just not looking at the data." In my consulting, people come to me with problems all the time, and the first thing I'll say is, "Let's go look at your traces." You can see their eyes pop open and be like, "What do you mean? " I'm like, "Yeah, let's look at it right now." They're surprised that I am going to go look at individual traces, and it always 100% of the time learn a lot and figure out what the problem is. I think people just don't know how powerful looking at the data is like we showed on this podcast. I would agree with that.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.