Existing LLMs with vision extensions are not truly trained to understand the world, particularly lacking intuitive physics and common sense reasoning.
there are LLMs that have some vision extension. But they're basically hacks in the sense that those things are not like trained to handle, to really understand the world. They're not trained with video, for example. They don't really understand intuitive physics, at least not at the moment.