High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / commitment

Published · transcript-backed

Ryan J. Salva: commitment

4 Sept 2022 Lenny's Podcast The role of AI in product development | Ryan J. Salva (VP of Product at GitHub, Copilot)

“We think that we've done a really good and responsible job of that by making sure that first, we are very clear that Copilot is not a replacement for a developer.”

— Ryan J. Salva

Source trail

Everything needed to verify it.

Speaker
Ryan J. Salva
Attribution
Verified speaker
Claim type
commitment
Recorded
4 Sept 2022
Publisher
Lenny's Podcast

Transcript context

…Interesting. And why is that? It's a couple of different reasons. I mean, one, like I said, we are trained on public code. Not all of the community is really sure like, when is it okay to train a model on public code? When is it not okay to train a model on public code? Is Copilot producing secure suggestions? Is Copilot producing bug buggy suggestions? There's a lot of doubt. There's a lot of very healthy skepticism. Actually I mean that genuinely. I want people to be skeptical of Copilot. We owe it to ourselves as a community to be skeptical of any AI. Because just like there's great potential for benefit, there's also great potential for harm. People keeping us accountable like, how are you preventing things like model poisoning? Is there going to be a new attack vector that we just haven't really thought of yet around AI that might produce negative consequences? We think that we've done a really good and responsible job of that by making sure that first, we are very clear that Copilot is not a replacement for a developer. It will never be. We do not want Copilot auto generating code where a thinking, reasoning, breathing human being is not on the other side of that keyboard making recent decisions. We do not want Copilot to replace any other part of the stack, whether it is static analysis tools or your unit tests or whatever kind of measures you're putting in today to make sure that your humans produce good quality code. We want you to keep all of those same systems in place to make sure that humans who are leveraging tools like Copilot continue to produce that good quality code. But there's a lot of at the same time anxiety of like, where is AI stack? Is AI eventually going to be... This is back to your question about where will we be five, 10 years from now. Will it be writing 90% of the code? We don't want Copilot to be that... We don't want it to replace anything. We want it to augment. The idea here is really that AI is an enabler for developers to focus on the creative work, to stay in the flow, to be able to move faster. Working through those anxieties, working through that healthy skepticism takes conversation. It takes dialogue. And that takes us on the product side having that guided conversation with the community. It feels like it connects back to your education back in the day, philosophy and literature. How convenient is that?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence