Qualitative reports of increased productivity from developers using AI tools conflict with quantitative metrics showing a 20% reduction in merged pull requests, suggesting mixed effectiveness.
But in fact, if you look at their output and how much was actually merged back in, there was a 20% downlift. They were less productive as a result of using these models.