Evidence receipt / evaluation
Published · transcript-backedHamel Husain: evaluation
25 Sept 2025 Lenny's Podcast Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar (creators of the #1 eval course)
“Can't the AI just eval it?" That's the most common misconception, and people want that so much that people do sell it, but it doesn't work.”
Source trail
Everything needed to verify it.
- Speaker
- Hamel Husain
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 25 Sept 2025
- Publisher
- Lenny's Podcast
Transcript context
…So true, so true. This is the world we live in. Oh, my God. Okay. I want to ask about just top misconceptions people have with evals and top tips and tricks for being successful. Maybe just share one or two each of each. Let me just start with misconceptions, and maybe I'll go to the Hamel first. Just what are a couple of the most common misconceptions people have with eval still? The top one is, "Hey, I can just buy a tool, plug it in, and it'll do the eval for you. Why do I have to worry about this? We live in the age of AI. Can't the AI just eval it?" That's the most common misconception, and people want that so much that people do sell it, but it doesn't work. That's the first one. Shoot, many humans are still great. I think that's great news.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.