Yann LeCun observes that system two in human psychology involves deliberate planning using an internal world model.
And so this type of deliberate planning, which uses your internal world model, that's system two, this is what LLMs currently cannot do.