Andrej Karpathy recommends figuring out ways to remove some of the knowledge and to keep a cognitive core that contains the algorithms and the magic of intelligence and problem-solving.
What I think we have to do going forward—and this would be part of the research paradigms—is figure out ways to remove some of the knowledge and to keep what I call this cognitive core.