01 / prediction
I think, I mean like 90% of the problems are things that were estimated to take like an expert software engineer like less than an hour.
“I think, I mean like 90% of the problems are things that were estimated to take like an expert software engineer like less than an hour.”
- Speaker
- Olivia Watkins
- Episode
- ⚡️The End of SWE-Bench Verified — Mia Glaese & Olivia Watkins, OpenAI Frontier Evals & Human Data
- Publisher
- Latent Space