Nathan Labenz: belief

Transcript context

…'s pervasive. We often see the polished nonsense come where it looks polished, it looks finished, it looks like we've done the assignment. When we dive a little bit deeper, it's actually quite hollow. There's very little substance. That's part of it. That's the most visible form. But it's also, it's the shadow AI. It's the using AI that you can't explain in terms of the output. It's a whole host of different dimensions as well. I guess to give you my personal bot sitting and near miss of bot ******** experience, just in preparing for this conversation, I have an agent that's runs every day and it looks for new podcast bookings on my calendar. And then its job is to, and it does have pretty good access, but this anecdote goes to show just how important connecting all the dots is. because for lack of 1 connection, the result came out not so good. But I've given this agent access to my drive and in my drive, I've got hundreds of these previous documents where I've written up these outlines of questions. So it can go in and look at all those that I've previously done and use those for inspiration. Of course, it can go search the web and whatever. And so it saw you pop up on the calendar and then it went and did its thing and did a big, pretty extensive deep dive into your background and your book and which we can touch on a little later as well. And the previous reports and things you've been involved with. And it missed one point, which is that there's this new report, which I had gotten a copy of in e-mail from one of your teammates, not specifically sent by you. And so basically the whole thing was not gonna work. It was like maybe 10 to 20% of that was the conversation we actually were gonna wanna have, but it missed. plus percent of the substance of what we were really going to be talking about. And I think I know better and I didn't send that off without noticing that. But if I had, it would have been, I would think textbook bot ******** behavior, which I do think we should all be very much watching out for. Now I got a much better result when I said, hey, you missed something really crucial, which is the report we're actually going to be focusing on. And then still there's another round where I feel like to do a good job, to be respectful to you as a guest, to be respectful of the audience who's trusting me with their time, which is obviously the one resource they can't possibly get more of, is I have to come having internalized that information and ready to make it my own. So even though I did get a great jump and a very meaningful assist from the agent, And in some sense, it was maybe good enough as an artifact that I could have shared and you would have been like, this is fine. Good thorough outline of questions. I still need to do that extra work to be able to show up and have the interaction in a way that hopefully allows me to do a good job and not feel like I'm making it up or reading it cold as I go. So I definitely relate to those two different things. I think I've had fortunately very few instances where I've let something get away from me without noticing that the bots have gone haywire. And I wonder, what do you think is the root of this problem, especially the bot ******** one, where people are just putting work out there into their team environment that they can't even defend? What's the root of that? o you think is the root of this problem, especially the bot ******** one, where people are just putting work out there into their team environment that they can't even defend? What's the root of that? Is it that they don't understand that the AI is not always going to do a good job? Is it that they're just alienated in the 1st place and fundamentally don't care? Are they low? Obviously, there's an issue in general with not everybody is super conscientious. So maybe this is just a new flavor of not doing a very good job for some people. What can you tell me about the psychology or how do you understand the mistake people are making when they do that?…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.