Jenny Wen: evaluation

Transcript context

…And a big part of this is you could argue ... the question is what leads to the best, most successful products in companies? And you could argue it's spending time doing discovery, user research, mocks, iterating, beta testing, or it could be just engineer shipper stuff that's okay, not amazing, good enough. We learn, iterate, build, iterate. Is your sense that that second path, not only is that just what everyone's doing, but that actually leads to the better product at this point? I think you sort of have to choose and use your discretion as to when to actually ship something, but I think the ability to execute, try something out and try it with real data, and a real user's kind of mindset in the product, I think that does lead to a better product, especially as we're all working with these new developing AI models that are non-deterministic, you can't mock up all the states, and you can't theorize and you can't even make a clickable prototype with it. You sort of have to use the actual models underneath, and you have to see people try it out with their use cases, because with these models, you can design them for different use cases, but you actually discover use cases as you see people using them. So yes. The other thing I always hear, and building on what you just said is just you don't know what people will do with AI. You don't know how good it'll be at certain things, the non-deterministic piece of it. So you can create these amazing mocks of what it might be, and then people use it in a completely different way, which is where Cowork came from, and probably even Claude Code at the beginning. And so what's it just like to be a designer at Anthropic? Just give us a day in the life of working at Anthropic, at the center of the storm.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.