Evidence receipt / belief
Published · transcript-backedTri Dao: belief
26 Jul 2023 Latent Space FlashAttention 2: making Transformers 800% faster w/o approximation - with Tri Dao of Together AI
“I think understanding jokes. I didn't expect that to happen, but it turns out scaling model up and training lots of data, the model can now understand jokes.”
— Tri Dao
Source trail
Everything needed to verify it.
- Speaker
- Tri Dao
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 26 Jul 2023
- Publisher
- Latent Space
Transcript context
…Awesome. Let's jump into the lightning round. Usually, I have two questions. So one is on acceleration, one on exploration, and then a takeaway. So the first one is, what's something that already happened in AI machine learning that you thought would take much longer than it has? I think understanding jokes. I didn't expect that to happen, but it turns out scaling model up and training lots of data, the model can now understand jokes. Maybe it's a small thing, but that was amazing to me. What about the exploration side? What are some of the most interesting unsolved questions in the space?…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.