High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Noam Shazeer

Published podcast speaker

Claims
12
Episodes
1
Shows
1
Named items
0

Claim ledger

What Noam said.

12 transcript-backed records

01 / recommendation

It really has to be a co-design thing because, if the algorithm designer doesn't realize that you can get greatly improved performance, throughput, with the lower precision, of course, the algorithm designer is going to say, "Of course, I don't want low precision.

“It really has to be a co-design thing because, if the algorithm designer doesn't realize that you can get greatly improved performance, throughput, with the lower precision, of course, the algorithm designer is going to say, "Of course, I don't want low precision.”
Speaker
Noam Shazeer
Publisher
Dwarkesh Podcast

02 / evaluation

Basically, what's happened is that at this point, arithmetic is very, very cheap, and moving data around is comparatively much more expensive. So pretty much all of deep learning has taken off roughly because of that.

“Basically, what's happened is that at this point, arithmetic is very, very cheap, and moving data around is comparatively much more expensive. So pretty much all of deep learning has taken off roughly because of that.”
Speaker
Noam Shazeer
Publisher
Dwarkesh Podcast

09 / belief

We're working out the algorithms as we speak. So I believe we'll see better and better solutions to this as these many more than 10,000 researchers are hacking at it, many of them at Google.

“We're working out the algorithms as we speak. So I believe we'll see better and better solutions to this as these many more than 10,000 researchers are hacking at it, many of them at Google.”
Speaker
Noam Shazeer
Publisher
Dwarkesh Podcast

10 / belief

Let me try something different." So I think going forward, we're going to have some amount of top-down, some amount of bottom-up, so as to incentivize both of these behaviors: collaboration and flexibility.

“Let me try something different." So I think going forward, we're going to have some amount of top-down, some amount of bottom-up, so as to incentivize both of these behaviors: collaboration and flexibility.”
Speaker
Noam Shazeer
Publisher
Dwarkesh Podcast

12 / prediction

Talking to a language model is like 100 times cheaper than reading a paperback. So there is a huge amount of headroom there to say, okay, if we can make this thing more expensive but smarter, because we're 100x cheaper than reading a paperback, we're 10,000 times cheaper than talking to a customer support agent, or a million times or more cheaper than hiring a software engineer or talking to your doctor or lawyer.

“Talking to a language model is like 100 times cheaper than reading a paperback. So there is a huge amount of headroom there to say, okay, if we can make this thing more expensive but smarter, because we're 100x cheaper than reading a paperback, we're 10,000 times cheaper than talking to a customer support agent, or a million times or more cheaper than hiring a software engineer or talking to your doctor or lawyer.”
Speaker
Noam Shazeer
Publisher
Dwarkesh Podcast
Search evidence