Andrej Karpathy observes that reasoning and planning inside neural networks might be analogous to the prefrontal cortex.
when we're doing reasoning and planning inside the neural networks, doing reasoning traces for thinking models, that's kind of like the prefrontal cortex.