Wei Lin

I think one of the reasons we still do this static benchmark, we still wanted to explore, experiment whether we can automate this, because people, eventually, model developers need it to fast iterate their model.

“I think one of the reasons we still do this static benchmark, we still wanted to explore, experiment whether we can automate this, because people, eventually, model developers need it to fast iterate their model.”

Speaker

Wei Lin

Episode

In the Arena: How LMSys changed LLM Benchmarking Forever

Publisher

Latent Space