evaluation · 17 Oct 2025 · 12:48

Pre-training is a practical but imperfect analogy to evolution, as it provides a starting point for further learning like reinforcement learning.

That's why I call pre-training this crappy evolution. It's the practically possible version with our technology and what we have available to us to get to a starting point where we can do things like reinforcement learning and so on.

Watch at 12:48