LLM pre-training results in strong memorization capabilities but limited ability to learn abstract concepts quickly compared to children.
if you compare it to the opposite end of the spectrum, you have LLM pre-training, where these models will literally be able to regurgitate word-for-word what is the next thing in a Wikipedia page. But their ability to learn abstract concepts really quickly, the way a child can, is much more limited.