High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / commitment

Published · transcript-backed

Shawn Wang: commitment

2 Aug 2024 Latent Space The Winds of AI Winter (Q2 Four Wars Recap) + ChatGPT Voice Mode Preview

“I will call out, you know, they have some interesting experimentations with Mamba and Mistral NEMO is actually on the efficiency frontier chart that I drew that is still relevant.”

— Shawn Wang

Source trail

Everything needed to verify it.

Speaker
Shawn Wang
Attribution
Verified speaker
Claim type
commitment
Recorded
2 Aug 2024
Publisher
Latent Space

Transcript context

…Yeah, exactly. It's a very big elephant and we're only touching pieces of it. It's blind leading the blind. I will call out, you know, they have some interesting experimentations with Mamba and Mistral NEMO is actually on the efficiency frontier chart that I drew that is still relevant. So don't discount Mistral NEMO, but Mistral Large otherwise, like it's an update. It's a necessary update for Mistral Large V1. But other than that, they're just kind of holding the line, not really advancing the field yet. That'll be my statement there. So those are the frontier big labs. Yes. And then now we're going to shift a little bit towards the smaller deployable on device solutions. Yeah. First of all, shout out to our friend, 3DAO, who released Flash Attention 3, Flash Attention 2. We kind of did a deep dive on the podcast. He came on in the studio back then. It's just great to see how small groups can make a big impact on a whole industry just like by making math better. So it's just great to see. I just wanted to give 3 a shout out.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence