paper / built
Scaling Monosemanticity
“Even with this, for people who aren't familiar we made Golden Gate Claude when we released our paper, “Scaling Monosemanticity”, where one of the 30 million features was for the Golden Gate Bridge.”
Public evidence record
Trenton Bricken
Published podcast speaker
- Claims
- 65
- Episodes
- 3
- Shows
- 1
- Named items
- 1
Books, apps, and tools
The evidenced stack.
Claim ledger
What Trenton said.
6 transcript-backed records
01 / evaluation
Even with this, for people who aren't familiar we made Golden Gate Claude when we released our paper, “Scaling Monosemanticity”, where one of the 30 million features was for the Golden Gate Bridge.
“Even with this, for people who aren't familiar we made Golden Gate Claude when we released our paper, “Scaling Monosemanticity”, where one of the 30 million features was for the Golden Gate Bridge.”
- Speaker
- Trenton Bricken
- Publisher
- Dwarkesh Podcast
02 / evaluation
I think again, we take for granted how much we need to show humans how to do specific tasks, and there's a failure to generalize here.
“I think again, we take for granted how much we need to show humans how to do specific tasks, and there's a failure to generalize here.”
- Speaker
- Trenton Bricken
- Publisher
- Dwarkesh Podcast
03 / evaluation
It would also discourage you from going to the doctor if you needed to, or calling 911. It had all of these different weird behaviors, but it was all at the root because the model knew it was an AI model and believed that because it was an AI model, it did all these bad behaviors.
“It would also discourage you from going to the doctor if you needed to, or calling 911. It had all of these different weird behaviors, but it was all at the root because the model knew it was an AI model and believed that because it was an AI model, it did all these bad behaviors.”
- Speaker
- Trenton Bricken
- Publisher
- Dwarkesh Podcast
04 / evaluation
Lots of people think that because we made neural networks, because they're artificial intelligence, we have a perfect understanding of how they work.
“Lots of people think that because we made neural networks, because they're artificial intelligence, we have a perfect understanding of how they work.”
- Speaker
- Trenton Bricken
- Publisher
- Dwarkesh Podcast
05 / evaluation
Or it's like everything is embodied and you're just a dynamical system that's operating along some predictable equations but there's no state in the system. But whenever I've read these sorts of critiques I think, “well, you're just choosing to not call this thing a state, but you could call any internal component of the model a state.
“Or it's like everything is embodied and you're just a dynamical system that's operating along some predictable equations but there's no state in the system. But whenever I've read these sorts of critiques I think, “well, you're just choosing to not call this thing a state, but you could call any internal component of the model a state.”
- Speaker
- Trenton Bricken
- Publisher
- Dwarkesh Podcast
06 / evaluation
My one gripe–I guess I have two gripes with this though, maybe three. So in the AlphaFold paper, one of the transformer modules–they have a few and the architecture is very intricate–but they do, I think, five forward passes through it and will gradually refine their solution as a result.
“My one gripe–I guess I have two gripes with this though, maybe three. So in the AlphaFold paper, one of the transformer modules–they have a few and the architecture is very intricate–but they do, I think, five forward passes through it and will gradually refine their solution as a result.”
- Speaker
- Trenton Bricken
- Publisher
- Dwarkesh Podcast