Yann LeCun predicts that future systems capable of planning will not rely on autoregressive prediction of tokens.
And it's not going to be autoregressive prediction of tokens, it's going to be more something akin to inference of latent variables in what used to be called probabilistic models or graphical models and things of that type.