Speaker unverified: evaluation

Transcript context

…to being like, I didn't think the models were having subjective experiences. And then I read this paper and now I do like I, my claim would be like, no rational person should ever utter that sentence. Let a portfolio of evidence emerge and then let the sort of cards fall where they may. Because this stuff is there's just noise at every point, even in what we're how to define consciousness, how to look for it, making sure you're measuring what you think you're measuring, looking at, you know, various aspects that we think are associated with consciousness. All of these things have you're sort of playing an intellectual game of broken telephone to some degree with each of these steps. And so let a portfolio of evidence arise and judge that don't over index on anyone paper is what I would say including my papers. We talk a lot on this show about how AI is raising the ceiling of human performance, taking us from basic data collection to deep contextual reasoning. A perfect example is how RoboFlow is now being used by founders to build the AI Moneyball for sports. AI in sports is incredibly hard. Nobody has built the killer app yet, because you're dealing with different environments, weird lighting, and camera angles that shift from broadcast height to floor level. If your model misses the ball or misidentifies a player, the analytics fall apart. But in the last 12 months, tons of builders have started using RoboFlow to launch sports analytics companies. RoboFlow is the infrastructure that makes the physical world programmable. Now is the time to start building. Go to roboflow.com to read the PlayVision story and start your first project for free. That's roboflow.com. Well, that's perfect tee up for me to kind of lay out an agenda for us for the next chunk of time. I would love to get your kind of guided tour through a few different lines of research and then we can go particularly deep on yours. You're kind of touching already on introspection, which has been an interesting one to watch. There has been obviously a lot more welfare investigation done, particularly at Anthropic over the last few months. And then there's also that emotion work from Anthropic. And I'm not sure if that's even the best way to kind of organize it. You can propose a different taxonomy of research if you want, but I I think it would be great to get an overview of each of those. And then we can go particularly deep onto a couple of papers you're going to be publishing soon. How's that sound? And would you like to start with introspection?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.