Evidence receipt / prediction
Published · transcript-backedTri Dao: prediction
26 Jul 2023 Latent Space FlashAttention 2: making Transformers 800% faster w/o approximation - with Tri Dao of Together AI
“We have some ideas. And in the future, I think we will need to design architecture that explicitly has some kind of reasoning module in it if we want to have much more capable models.”
— Tri Dao
Source trail
Everything needed to verify it.
- Speaker
- Tri Dao
- Attribution
- Verified speaker
- Claim type
- prediction
- Recorded
- 26 Jul 2023
- Publisher
- Latent Space
Transcript context
…What about the exploration side? What are some of the most interesting unsolved questions in the space? I would say reasoning in the broad term. We don't really know how these models do. Essentially, they do something that looks like reasoning. We don't know how they're doing it. We have some ideas. And in the future, I think we will need to design architecture that explicitly has some kind of reasoning module in it if we want to have much more capable models. What's one message you want everyone to remember today?…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.