Evidence receipt / evaluation
Published · transcript-backedNicole Forsgren: evaluation
19 Oct 2025 Lenny's Podcast How to measure AI developer productivity in 2025 | Nicole Forsgren
“Because they were so systematic about it upfront, they're much closer to something that looks like production code.”
Source trail
Everything needed to verify it.
- Speaker
- Nicole Forsgren
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 19 Oct 2025
- Publisher
- Lenny's Podcast
Transcript context
…Is there anything more you could say about this engineer that figured out this really cool workflow, about just what that looks like? I've spoken with a handful of them, and I've kind of watched them work. I haven't built it myself yet. It's on my list. They've been able to set up this really incredible workspace and workflow where... Right now, a lot of us play around with tools and... We'll put in a prompt and we'll get a few lines back or maybe we'll put in a prompt and we'll get whole programs back. Well, what they can do is they can... Many times I'll see them say, to help prime it, "This is what I want to build. It needs to have these basic architectural components. It needs to have this kind of a stack. It needs to follow this general workflow. Help me think that through," and it'll kind of design it for it. And then for each piece, it'll assign an agent to go work on each pace in parallel, and then it'll say and upfront, "These need to be able to work together, make sure it's architected correctly. Make sure we use appropriate APIs and conventions." Then at the end, they can let it run for a few minutes. They can think through something else that's interesting or they anticipate is going to be hairy, and they come back to something that's probably a little better than vibe coded. Because they were so systematic about it upfront, they're much closer to something that looks like production code. So what I'm hearing is spending a little time upfront planning, what all these AI engineers are doing, versus just powering through and just figuring out as you go.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.