Evidence receipt / belief
Published · transcript-backedShreya Shankar: belief
25 Sept 2025 Lenny's Podcast Why AI evals are the hottest new skill for product builders | Hamel Husain & Shreya Shankar (creators of the #1 eval course)
“I think you can if you want to, but the whole game here is about prioritizing. You have finite resources and finite time, you can't write an eval for everything, so prioritize the ones that are the more pesky areas.”
Source trail
Everything needed to verify it.
- Speaker
- Shreya Shankar
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 25 Sept 2025
- Publisher
- Lenny's Podcast
Transcript context
…Got it. Say you found a problem, you fixed it. In traditional software development, you'd write a unit test to make sure it doesn't happen again. Is your insight here is, "Don't even bother writing an eval around that if it's just gone"? I think you can if you want to, but the whole game here is about prioritizing. You have finite resources and finite time, you can't write an eval for everything, so prioritize the ones that are the more pesky areas. Probably the ones that are most risky to your business if they say something like Mecha Hitler, Grok.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.