High Signal Podcasts Evidence ledger
Method
Browse

Public evidence record

Tri Dao

Published podcast speaker

Claims
21
Episodes
1
Shows
1
Named items
0

Claim ledger

What Tri said.

7 transcript-backed records

01 / belief

Things like, I think compilers will play a role because compilers allow you to maybe still be much more efficient across different kinds of hardware because essentially you write the same code and compiler will be able to make it run efficiently different kinds of hardware.

“Things like, I think compilers will play a role because compilers allow you to maybe still be much more efficient across different kinds of hardware because essentially you write the same code and compiler will be able to make it run efficiently different kinds of hardware.”
Speaker
Tri Dao
Publisher
Latent Space

02 / belief

Yeah, I think mostly on the practical side is that you lose a little bit of flexibility in the sense that, hey, now you have, for example, faster attention, it's just a subroutine that you would call to do attention.

“Yeah, I think mostly on the practical side is that you lose a little bit of flexibility in the sense that, hey, now you have, for example, faster attention, it's just a subroutine that you would call to do attention.”
Speaker
Tri Dao
Publisher
Latent Space

03 / belief

I think understanding jokes. I didn't expect that to happen, but it turns out scaling model up and training lots of data, the model can now understand jokes.

“I think understanding jokes. I didn't expect that to happen, but it turns out scaling model up and training lots of data, the model can now understand jokes.”
Speaker
Tri Dao
Publisher
Latent Space

04 / belief

I think when we were writing the paper, I remember sending an email to one of my advisors, and like, hey, I'm excited about this paper, but I think the most important thing will be the artifact, which is the code.

“I think when we were writing the paper, I remember sending an email to one of my advisors, and like, hey, I'm excited about this paper, but I think the most important thing will be the artifact, which is the code.”
Speaker
Tri Dao
Publisher
Latent Space

05 / belief

People do contribute to evaluation and measurement. And as a whole, I think people try to contribute to the field and move the field forward, albeit that maybe slightly different directions.

“People do contribute to evaluation and measurement. And as a whole, I think people try to contribute to the field and move the field forward, albeit that maybe slightly different directions.”
Speaker
Tri Dao
Publisher
Latent Space

07 / belief

I think Tesla also has this Dojo supercomputer where they try to have essentially as fast on-chip memory as possible and removing some of these data transfer back and forth.

“I think Tesla also has this Dojo supercomputer where they try to have essentially as fast on-chip memory as possible and removing some of these data transfer back and forth.”
Speaker
Tri Dao
Publisher
Latent Space
Search evidence