other / uses
Gwern's book reviews
“The book reviews is a good suggestion. I actually use, like, Gwern's book reviews as a way to recommend books to people.”
Public evidence record
Sholto Douglas
Published podcast speaker
- Claims
- 59
- Episodes
- 3
- Shows
- 1
- Named items
- 1
Books, apps, and tools
The evidenced stack.
Claim ledger
What Sholto said.
7 transcript-backed records
01 / evaluation
Because a lot of the tasks required in winning a Nobel Prize—or at least strongly assisting in helping to win a Nobel Prize—have more layers of verifiability built up.
“Because a lot of the tasks required in winning a Nobel Prize—or at least strongly assisting in helping to win a Nobel Prize—have more layers of verifiability built up.”
- Speaker
- Sholto Douglas
- Publisher
- Dwarkesh Podcast
02 / evaluation
I think my answer at the moment is that the sort of pre-training objective doesn't necessarily- like it imbues with this nice flexible general knowledge about the world, but doesn't necessarily imbue the skill of making novel connections or research.
“I think my answer at the moment is that the sort of pre-training objective doesn't necessarily- like it imbues with this nice flexible general knowledge about the world, but doesn't necessarily imbue the skill of making novel connections or research.”
- Speaker
- Sholto Douglas
- Publisher
- Dwarkesh Podcast
03 / evaluation
That is a reasonably long horizon task, but it's still sub-hour as opposed to a multi-hour or multi-day task. So I think one of the things that will be really important to do next is understand better what success rate over long-horizon tasks looks like.
“That is a reasonably long horizon task, but it's still sub-hour as opposed to a multi-hour or multi-day task. So I think one of the things that will be really important to do next is understand better what success rate over long-horizon tasks looks like.”
- Speaker
- Sholto Douglas
- Publisher
- Dwarkesh Podcast
04 / evaluation
I think we are less, at the moment, bound by the sheer engineering work of making these things than we are by compute to run and get signal, and taste in terms of what the actual right thing to do is.
“I think we are less, at the moment, bound by the sheer engineering work of making these things than we are by compute to run and get signal, and taste in terms of what the actual right thing to do is.”
- Speaker
- Sholto Douglas
- Publisher
- Dwarkesh Podcast
05 / evaluation
Until I started working on it, I didn't really appreciate how much of a step up in intelligence it was for the model to have the onboarding problem basically instantly solved.
“Until I started working on it, I didn't really appreciate how much of a step up in intelligence it was for the model to have the onboarding problem basically instantly solved.”
- Speaker
- Sholto Douglas
- Publisher
- Dwarkesh Podcast
06 / evaluation
I mean problems that haven't been particularly well-solved so far, but perhaps as a result of frustrating structural factors like the ones that you pointed out in that scenario before, where they're like, “we can't do X because this team won’t do Y.
“I mean problems that haven't been particularly well-solved so far, but perhaps as a result of frustrating structural factors like the ones that you pointed out in that scenario before, where they're like, “we can't do X because this team won’t do Y.”
- Speaker
- Sholto Douglas
- Publisher
- Dwarkesh Podcast
07 / evaluation
There's a line of work I quite like, where it looks at in-context learning as basically very similar to gradient descent, but the attention operation can be viewed as gradient descent on the in-context data. That paper had some cool plots where they basically showed “we take n steps of gradient descent and that looks like n layers of in-context learning, and it looks very similar.
“There's a line of work I quite like, where it looks at in-context learning as basically very similar to gradient descent, but the attention operation can be viewed as gradient descent on the in-context data. That paper had some cool plots where they basically showed “we take n steps of gradient descent and that looks like n layers of in-context learning, and it looks very similar.”
- Speaker
- Sholto Douglas
- Publisher
- Dwarkesh Podcast