Autoregressive LLMs lack essential components for human-level intelligence, such as understanding the physical world, persistent memory, reasoning, and planning.
they don't really understand the physical world, they don't really have persistent memory, they can't really reason and they certainly can't plan. And so if you expect the system to become intelligent just without having the possibility of doing those things, you're making a mistake.