01 / observation

8 Jan 2026

Interestingly in Tal, um, Tal2Bench Telecom, it’s cheaper to run, you know, on a per token basis, more expensive models like a GBD5 compared to some smaller open source models, because the, um, some of the GBD5, for instance, uh, got to the answer faster.

“Interestingly in Tal, um, Tal2Bench Telecom, it’s cheaper to run, you know, on a per token basis, more expensive models like a GBD5 compared to some smaller open source models, because the, um, some of the GBD5, for instance, uh, got to the answer faster.”

Speaker: George Cameron
Episode: Artificial Analysis: Independent LLM Evals as a Service — with George Cameron and Micah-Hill Smith
Publisher: Latent Space

What George said.

Interestingly in Tal, um, Tal2Bench Telecom, it’s cheaper to run, you know, on a per token basis, more expensive models like a GBD5 compared to some smaller open source models, because the, um, some of the GBD5, for instance, uh, got to the answer faster.