Daniel Miessler: uncertainty

Transcript context

…would say. So earlier you mentioned that your friend is like earning more bug bounties by doing something like this. Do you measure your own productivity in any similar way? And how much boost do you think you've got? And then as this presumably continues to create more and more leverage, that seems to imply that like you'll have to have yourself in the loop with lower and lower frequency, right? If in the limit of this sort of thing, you're only able to review so many things and make so many decisions. This is the gradual disempowerment people would be saying, hey, you're talking about it right now. But if it's performing well enough, you'll be reviewing the things that matter and you won't be reviewing the things that don't. Where are we, what can you measure about your own output today? And where are you in terms of like how much scope of action you give the system? Does it ever send a response to an email? Does it ever send an email as you that you didn't review? Or do you like allow it to respond as itself without signing it as you, but like still try to move things forward without you actually being in that loop? Would you allow it to spend money on your behalf without you signing off that yes, you want to execute that transaction? Are there Are there other frontiers of action that you're watching the line move on what on you what you do and don't need to be looped in on? Yeah, great. I would say that being naturally a little bit cautious, I would say the scaffolding is not there yet for a whole lot of trust in this regard. When I'm sitting here watching it, I've got a big part of my hook system is actually a whole bunch of defenses, watching it, watching what the agents are doing, making sure it's not accessing certain files and directories. And that uses the cloud code underlying system. It's got a whole bunch of cool permissions. I don't run dangerously skip permissions anymore. I used to. I turned that off. So I've got a whole like security scaffold there for file system access and stuff like that. Then I have a whole bunch of prompt injection defenses because those are massively dangerous as well. And I keep those layered. I just don't feel like the scaffolding is there yet to be like, hey, whatever. Here's my bank accounts. Just run with it. I would say I'm okay with experiments. Okay, here's a separate bank account. It's only got $1,000 in it. Go crazy. Like you've probably seen the vending machine benchmark. Yeah.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.