Evidence receipt / evaluation
Published · transcript-backedCristopher Moore: evaluation
4 Sept 2025 Machine Learning Street Talk The Day AI Solves My Puzzles Is The Day I Worry (Prof. Cristopher Moore)
“I think what's fascinating is that that real world structure seems very hard to mathematize.”
Source trail
Everything needed to verify it.
- Speaker
- Cristopher Moore
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 4 Sept 2025
- Publisher
- Machine Learning Street Talk
Transcript context
…Put it past a bit. Just past, because you don't want them to bounce off. You know, the real world has all this rich hierarchy of objects and parts of objects. I think what's fascinating is that that real world structure seems very hard to mathematize. We need more compute. I'm like, oh, that does not sound right in my ears. Are you a bird or a frog? I'm more of a frog. A lot of twentieth century mathematics was about soaring above. Right? Real world data is not designed by an adversary to be as tricky as possible. So, I'm proud to say 8 of my puzzles are in that dataset. So, I'm waiting to see if AI can solve my puzzles. But, I hope that we understand that, wow, this is actually really deep and amazing. What's fascinating about the LLM world is that Quick pause before we kick off with Chris. Human data is shaping the direction of frontier AI, yet there's little visibility about how teams are actually using it. Our sponsor, Prolific, are putting together their first report on human data in AI and they need volunteers. It just takes a few minutes to fill out and you'll also get early access to their findings so you can see how you compare. They're just asking about things like evaluation methods and data sourcing approaches, so nothing personally identifiable. Check the link in the description. Much appreciated. And the episode is also brought to you by Cyberfund, is a thesis driven investment firm led by founders who've built companies from 0 to billions. They've sponsored MLST for the next year, so I'm absolutely thrilled to have their support. It's amazing. They're looking for the few out there who are gonna define the next decade of AI. And if that's you, they wanna talk. So, if you ship even faster than Janik Kilcher used to read machine learning papers before ChatGPT came out, of course, visit cyber.com to learn more. Back to Chris.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.