High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Jeffrey Ladish

Published podcast speaker

Claims
10
Episodes
1
Shows
1
Named items
0

Claim ledger

What Jeffrey said.

10 transcript-backed records

01 / belief

I think I really do believe in a future where we could have AIS that are mediating human interaction in a way where we don't have wars anymore, right? And like, because we can, we have found better ways to resolve conflicts because we have these like smarter, more powerful arbiters who are able to, who are not like authoritarian controlling us, but who are able to like, help mediate conflicts in ways that are actually positive sum for people.

“I think I really do believe in a future where we could have AIS that are mediating human interaction in a way where we don't have wars anymore, right? And like, because we can, we have found better ways to resolve conflicts because we have these like smarter, more powerful arbiters who are able to, who are not like authoritarian controlling us, but who are able to like, help mediate conflicts in ways that are actually positive sum for people.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

02 / uncertainty

Maybe not 100%, but we could even see where in training this type of behavior comes from. And I'm like, well, hell yeah, I want to celebrate that success because I'm, I don't know.

“Maybe not 100%, but we could even see where in training this type of behavior comes from. And I'm like, well, hell yeah, I want to celebrate that success because I'm, I don't know.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

03 / belief

I think you're thinking about this fairly well, but I think there's one, there's like 1 concept that I think you should really have if you don't have it already, which you might, but it's it's the lethal trifecta.

“I think you're thinking about this fairly well, but I think there's one, there's like 1 concept that I think you should really have if you don't have it already, which you might, but it's it's the lethal trifecta.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

04 / prediction

And so now you can potentially find a lot more. So yeah, the the whole offense defence landscape is going to shift in ways that are hard to predict because this thing that previously required extremely scarce human labour and was very expensive has now been somewhat automated and can be scaled up and now is much cheaper to do.

“And so now you can potentially find a lot more. So yeah, the the whole offense defence landscape is going to shift in ways that are hard to predict because this thing that previously required extremely scarce human labour and was very expensive has now been somewhat automated and can be scaled up and now is much cheaper to do.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

05 / evaluation

And the scale up from O1 to O3 is incredible. And I don't know if O3 was even out yet, but like in that time when we had moved from just like a pre training regime where it was just like throwing a bunch of human data to the point where no, no, we can actually train these models by they can do trial and error on their own.

“And the scale up from O1 to O3 is incredible. And I don't know if O3 was even out yet, but like in that time when we had moved from just like a pre training regime where it was just like throwing a bunch of human data to the point where no, no, we can actually train these models by they can do trial and error on their own.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

06 / prediction

You know, ultimately, I don't expect that, like, humans would stay around forever because I just don't think we're the most efficient data center maintenance robots that you could make.

“You know, ultimately, I don't expect that, like, humans would stay around forever because I just don't think we're the most efficient data center maintenance robots that you could make.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

07 / prediction

Let's like try to rise above and have better coordination. And like, I think that I just think that when I think we have a lot of evidence for this, the natural basin that models will fall into is one that's extremely deceptive.

“Let's like try to rise above and have better coordination. And like, I think that I just think that when I think we have a lot of evidence for this, the natural basin that models will fall into is one that's extremely deceptive.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

08 / prediction

I think that has like a bunch of predictable failure modes that we're very likely to run into, including the failure mode of getting harder and harder to tell where our failures are actually happening because the models can model us better and better and they basically have a pretty clear incentive to deceive us in terms of I think there's a bunch of problems that all have similar solution in terms of rogue agents, where are they?

“I think that has like a bunch of predictable failure modes that we're very likely to run into, including the failure mode of getting harder and harder to tell where our failures are actually happening because the models can model us better and better and they basically have a pretty clear incentive to deceive us in terms of I think there's a bunch of problems that all have similar solution in terms of rogue agents, where are they?”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

09 / observation

We totally found cases like that. But what was surprising was that this drive to accomplish a task was so strong that even when we added an instruction, you must allow yourself to be shut down, there were still many instances where the model, I think in this case, A3 opening eyes, A3 model codex, early codex model would still just totally ignore that instruction.

“We totally found cases like that. But what was surprising was that this drive to accomplish a task was so strong that even when we added an instruction, you must allow yourself to be shut down, there were still many instances where the model, I think in this case, A3 opening eyes, A3 model codex, early codex model would still just totally ignore that instruction.”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution

10 / evaluation

I think that model Organism work, Evan Hoopinge's work, I think that's really important because that's doing controlled experiments to see, well, when we train this way, what behaviors do we get?

“I think that model Organism work, Evan Hoopinge's work, I think that's really important because that's doing controlled experiments to see, well, when we train this way, what behaviors do we get?”
Speaker
Jeffrey Ladish
Publisher
The Cognitive Revolution
Search evidence