Evidence receipt / belief
Published · transcript-backedShawn Wang: belief
8 Jan 2026 Latent Space Artificial Analysis: Independent LLM Evals as a Service — with George Cameron and Micah-Hill Smith
“I think to some extent, I’m mixed opinion on that one because to some extent, your target audience is not people in AI Grants who are obviously at the frontier.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 8 Jan 2026
- Publisher
- Latent Space
Transcript context
…Oh, totally. Yeah, yeah, yeah. There was something about, you know, speaking to Nat and Daniel about the challenges of working through a startup and just working through the questions that don’t have, like, clear answers and how to work through those kind of methodically and just, like, work through the hard decisions. And they’ve been great mentors to us as we’ve built artificial analysis. Another benefit for us was that other companies in the batch and other companies in AI Grant are pushing the capabilities. Yeah. And I think that’s a big part of what AI can do at this time. And so being in contact with them, making sure that artificial analysis is useful to them has been fantastic for supporting us in working out how should we build out artificial analysis to continue to being useful to those, like, you know, building on AI. I think to some extent, I’m mixed opinion on that one because to some extent, your target audience is not people in AI Grants who are obviously at the frontier. Yeah. Do you disagree? To some extent. To some extent. But then, so a lot of what the AI Grant companies are doing is taking capabilities coming out of the labs and trying to push the limits of what they can do across the entire stack for building great applications, which actually makes some of them pretty archetypical power users of artificial analysis. Some of the people with the strongest opinions about what we’re doing well and what we’re not doing well and what they want to see next from us. Yeah. Yeah. Because when you’re building any kind of AI application now, chances are you’re using a whole bunch of different models. You’re maybe switching reasonably frequently for different models and different parts of your application to optimize what you’re able to do with them at an accuracy level and to get better speed and cost characteristics. So for many of them, no, they’re like not commercial customers of ours, like we don’t charge for all our data on the website. Yeah. They are absolutely some of our power users.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.