Evidence receipt / belief
Published · transcript-backedAlessio Fanelli: belief
23 Jul 2024 Latent Space Llama 2, 3 & 4: Synthetic Data, RLHF, Agents on the path to Open Source AGI
“I think folks were asking if you see that as an interesting direction to kind of having specific synthetic data generation things.”
Source trail
Everything needed to verify it.
- Speaker
- Alessio Fanelli
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 23 Jul 2024
- Publisher
- Latent Space
Transcript context
…Yeah. We love just Meta's commitment to open source and, you know, you do what you need to do to make it work for your organization. Do you have any other thoughts on the more synthetic data focused models, kind of like a Nemotron? I think folks were asking if you see that as an interesting direction to kind of having specific synthetic data generation things. I don't know about this model exactly, but I think like LlamaT had better performance overall. I'm very bullish on synthetic data generation, but I think just gets better when you have a better model. I'm not really bullish on having like a model only for synthetic data generation. I understand the need of having like bigger models, but then you can rationalizing, yeah, maybe people will not use them for inference, but to distillate some specific knowledge of synthetic data. That narrative is, I think I totally agree with that, but having a model purely for that and not like good at other things, I don't think it's the case.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.