High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Quentin Anthony

Published podcast speaker

Claims
16
Episodes
1
Shows
1
Named items
0

Claim ledger

What Quentin said.

2 transcript-backed records

01 / observation

The problem is that in practice, full utilization, that's the key word, right? Because in practice, there are a lot of cases where like you're spending time waiting on data movement from like the GPU to CPU.

“The problem is that in practice, full utilization, that's the key word, right? Because in practice, there are a lot of cases where like you're spending time waiting on data movement from like the GPU to CPU.”
Speaker
Quentin Anthony
Publisher
Latent Space

02 / observation

So once the hardware moved to V100, the software moved to like mixed precision and APEX and AMP and such. And one counterintuitive part of mixed precision is that you actually require more memory when you're trained because you need an FP16 copy of the weights and an FP32 copy of the weights.

“So once the hardware moved to V100, the software moved to like mixed precision and APEX and AMP and such. And one counterintuitive part of mixed precision is that you actually require more memory when you're trained because you need an FP16 copy of the weights and an FP32 copy of the weights.”
Speaker
Quentin Anthony
Publisher
Latent Space
Search evidence