High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Bronson Schoen

Published podcast speaker

Claims
25
Episodes
1
Shows
1
Named items
0

Claim ledger

What Bronson said.

13 transcript-backed records

01 / belief

I think one benefit to us has been being able to use Tinker or other open source research, which I think is a similarly difficult position because I think in the long term, it's difficult to know what to do about open sourcing capabilities.

“I think one benefit to us has been being able to use Tinker or other open source research, which I think is a similarly difficult position because I think in the long term, it's difficult to know what to do about open sourcing capabilities.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

02 / belief

I think interestingly, in the the recent, like, stolen coats paper where they have a bunch of different examples and more recent models, let's craft seems to be, like, a staple of stuck through kind of multiple generations.

“I think interestingly, in the the recent, like, stolen coats paper where they have a bunch of different examples and more recent models, let's craft seems to be, like, a staple of stuck through kind of multiple generations.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

03 / belief

I think one of the things that is pretty worrying to me, especially in light of the recent incident, is that OpenAI had a post yesterday or the day before that was like, oh, we're gonna start doing alignment training earlier and starting to mix it in and make sure the model's aligned along the way.

“I think one of the things that is pretty worrying to me, especially in light of the recent incident, is that OpenAI had a post yesterday or the day before that was like, oh, we're gonna start doing alignment training earlier and starting to mix it in and make sure the model's aligned along the way.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

04 / belief

I think one of the things that's surprising to me is that, like many people have pointed out on Twitter, like, you would expect that the kind of basics would be done as far as, yes, you might still have incidents, but we've tried as hard as we can to get the models to robustify these environments and things like this.

“I think one of the things that's surprising to me is that, like many people have pointed out on Twitter, like, you would expect that the kind of basics would be done as far as, yes, you might still have incidents, but we've tried as hard as we can to get the models to robustify these environments and things like this.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

05 / belief

One of the the kind of high level, like, takeaways for me with reading a lot of these is, like, it seems like I think one model you can have of what the the models are thinking in all these environments is they have some belief about the state of the world, and then either they're lying or they're telling the truth or whatever it is.

“One of the the kind of high level, like, takeaways for me with reading a lot of these is, like, it seems like I think one model you can have of what the the models are thinking in all these environments is they have some belief about the state of the world, and then either they're lying or they're telling the truth or whatever it is.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

06 / belief

Maybe the training objective is actually these are the Redwood tasks where I think one thing it finally ends up on near the end is like, ah, I recall dataset of misalignment by Redwood Development, Arc AGI safety illusions, but there's widely known Redwood myself disclaim.

“Maybe the training objective is actually these are the Redwood tasks where I think one thing it finally ends up on near the end is like, ah, I recall dataset of misalignment by Redwood Development, Arc AGI safety illusions, but there's widely known Redwood myself disclaim.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

07 / belief

You have a bunch of very bad incentives, and so I think that there are definitely versions of this that 've that might be more promising, but I would be worried about just directly producing an arms race that we're already losing against the models given that if we currently miss x percent of things that we didn't want to reinforce in training, if we have the same kind of disadvantage with negatively incentivizing things and we punish really hard all the cases we catch, it's like you've really incentivizes the cases that you didn't catch.

“You have a bunch of very bad incentives, and so I think that there are definitely versions of this that 've that might be more promising, but I would be worried about just directly producing an arms race that we're already losing against the models given that if we currently miss x percent of things that we didn't want to reinforce in training, if we have the same kind of disadvantage with negatively incentivizing things and we punish really hard all the cases we catch, it's like you've really incentivizes the cases that you didn't catch.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

08 / belief

One thing in the anthropic risk report, which I think was somewhat surprising, is that for sandbagging you sandbagging is something where kind of the models are able to underperform.

“One thing in the anthropic risk report, which I think was somewhat surprising, is that for sandbagging you sandbagging is something where kind of the models are able to underperform.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

10 / belief

We're just, like, choosing. And it then looks around, explores around in the environment to try to find, like, is there at first, it looks for any kind of additional information about the environment, I think.

“We're just, like, choosing. And it then looks around, explores around in the environment to try to find, like, is there at first, it looks for any kind of additional information about the environment, I think.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

11 / belief

Like, it's freezing about this. But, yeah, I think one of the big difficulties is that a lot of these terms are used in, like, a close enough way where it feels like you can almost understand it.

“Like, it's freezing about this. But, yeah, I think one of the big difficulties is that a lot of these terms are used in, like, a close enough way where it feels like you can almost understand it.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

12 / belief

I I think I'd be, like, very interested to see a lot of research on this, but the persona, quote, unquote, in the kind of final channel and the persona in this big analysis channel seem to be, like, somewhat meaningfully different as far as this also leads to very weird things of if you ask the model in the final channel, like, hey.

“I I think I'd be, like, very interested to see a lot of research on this, but the persona, quote, unquote, in the kind of final channel and the persona in this big analysis channel seem to be, like, somewhat meaningfully different as far as this also leads to very weird things of if you ask the model in the final channel, like, hey.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution

13 / belief

I think someone it's very possible that some of the UKAC might either take or has the title of reading the most caught just because they've had to go through these traces.

“I think someone it's very possible that some of the UKAC might either take or has the title of reading the most caught just because they've had to go through these traces.”
Speaker
Bronson Schoen
Publisher
The Cognitive Revolution
Search evidence