01 / prediction
Parameter count should grow much faster than context length actually, just because of the underlying physics of what's available.
“Parameter count should grow much faster than context length actually, just because of the underlying physics of what's available.”
- Speaker
- Reiner Pope
- Publisher
- Cheeky Pint