Andrej Karpathy observes that the real intelligence is visible in the in-context learning process.
That's where I feel like the real intelligence is that you can visibly see. That in-context learning process is developed by gradient descent on pre-training.