Evidence receipt / commitment
Published · transcript-backedShawn Wang: commitment
2 Aug 2024 Latent Space The Winds of AI Winter (Q2 Four Wars Recap) + ChatGPT Voice Mode Preview
“I will call out, you know, they have some interesting experimentations with Mamba and Mistral NEMO is actually on the efficiency frontier chart that I drew that is still relevant.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- commitment
- Recorded
- 2 Aug 2024
- Publisher
- Latent Space
Transcript context
…Yeah, exactly. It's a very big elephant and we're only touching pieces of it. It's blind leading the blind. I will call out, you know, they have some interesting experimentations with Mamba and Mistral NEMO is actually on the efficiency frontier chart that I drew that is still relevant. So don't discount Mistral NEMO, but Mistral Large otherwise, like it's an update. It's a necessary update for Mistral Large V1. But other than that, they're just kind of holding the line, not really advancing the field yet. That'll be my statement there. So those are the frontier big labs. Yes. And then now we're going to shift a little bit towards the smaller deployable on device solutions. Yeah. First of all, shout out to our friend, 3DAO, who released Flash Attention 3, Flash Attention 2. We kind of did a deep dive on the podcast. He came on in the studio back then. It's just great to see how small groups can make a big impact on a whole industry just like by making math better. So it's just great to see. I just wanted to give 3 a shout out.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.