01 / recommendation
Absolutely. And these are the kind of architectures we should explore more, where small models… And this is also why I believe open source is important, because at least it gives you a good base model to start with and try different experiments in the post-training phase to see if you can just specifically shape these models for being good reasoners.
“Absolutely. And these are the kind of architectures we should explore more, where small models… And this is also why I believe open source is important, because at least it gives you a good base model to start with and try different experiments in the post-training phase to see if you can just specifically shape these models for being good reasoners.”
- Speaker
- Aravind Srinivas
- Publisher
- Lex Fridman Podcast