app / uses
Claude
“We have some very early agents that are extremely impressive and that I use daily—Claude and Codex and so on—but I still feel there’s so much work to be done.”
Public evidence record
Andrej Karpathy
Researcher · Eureka Labs
- Claims
- 38
- Episodes
- 1
- Shows
- 1
- Named items
- 3
Books, apps, and tools
The evidenced stack.
app / uses
Codex
“We have some very early agents that are extremely impressive and that I use daily—Claude and Codex and so on—but I still feel there’s so much work to be done.”
course / built
CS231n
“Earlier on, I built CS231n at Stanford, which I think was the first deep learning class at Stanford, which became very popular.”
Claim ledger
What Andrej said.
16 transcript-backed records
01 / belief
I think that’s right. If you’re sticking to the realm of bits, bits are a million times easier than anything that touches the physical world.
“I think that’s right. If you’re sticking to the realm of bits, bits are a million times easier than anything that touches the physical world.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
02 / belief
The first one I would say is culture and LLMs having a growing repertoire of knowledge for their own purposes.
“The first one I would say is culture and LLMs having a growing repertoire of knowledge for their own purposes.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
03 / belief
I am betting a bit implicitly on some of the timelessness of human nature. It will be desirable to do all these things, and I think people will look up to it as they have for millennia.
“I am betting a bit implicitly on some of the timelessness of human nature. It will be desirable to do all these things, and I think people will look up to it as they have for millennia.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
04 / belief
I still think you’re presupposing some discrete jump that has no historical precedent that I can’t find in any of the statistics and that I think probably won’t happen.
“I still think you’re presupposing some discrete jump that has no historical precedent that I can’t find in any of the statistics and that I think probably won’t happen.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
05 / belief
You just take all the course materials and then I think you could serve a very good automated TA for the student when they have more basic questions or something like that.
“You just take all the course materials and then I think you could serve a very good automated TA for the student when they have more basic questions or something like that.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
06 / belief
Text is maybe a lot more flowery, and there’s a lot more entropy in text, I would say.
“Text is maybe a lot more flowery, and there’s a lot more entropy in text, I would say.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
07 / belief
One example that’s prominently in my mind, this was probably public, if you’re using an LLM judge for a reward, you just give it a solution from a student and ask it if the student did well or not.
“One example that’s prominently in my mind, this was probably public, if you’re using an LLM judge for a reward, you just give it a solution from a student and ask it if the student did well or not.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
08 / belief
We could also look at it with respect to how many times we think certain intelligence has individually sprung up.
“We could also look at it with respect to how many times we think certain intelligence has individually sprung up.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
09 / belief
In my mind, education is the very difficult technical process of building ramps to knowledge. In my mind, nanochat is a ramp to knowledge because it’s very simple.
“In my mind, education is the very difficult technical process of building ramps to knowledge. In my mind, nanochat is a ramp to knowledge because it’s very simple.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
10 / belief
LLMs don’t really have culture right now and it’s one of the impediments I would say.
“LLMs don’t really have culture right now and it’s one of the impediments I would say.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
11 / belief
Then I think you get away with a much smaller model because it’s a much better dataset and you could train it on it.
“Then I think you get away with a much smaller model because it’s a much better dataset and you could train it on it.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
12 / belief
I think that’s probably holding back the neural networks overall because it’s getting them to rely on the knowledge a little too much sometimes.
“I think that’s probably holding back the neural networks overall because it’s getting them to rely on the knowledge a little too much sometimes.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
13 / belief
Even the early iPhone didn’t have the App Store, and it didn’t have a lot of the bells and whistles that the modern iPhone has. So even though we think of 2008, when the iPhone came out, as this major seismic change, it’s actually not.
“Even the early iPhone didn’t have the App Store, and it didn’t have a lot of the bells and whistles that the modern iPhone has. So even though we think of 2008, when the iPhone came out, as this major seismic change, it’s actually not.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
14 / belief
I care not just about all the Dyson spheres that we’re going to build and that AI is going to build in a fully autonomous way, I care about what happens to humans.
“I care not just about all the Dyson spheres that we’re going to build and that AI is going to build in a fully autonomous way, I care about what happens to humans.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
15 / belief
I think that’s the most likely outcome, that there will be a gradual loss of understanding.
“I think that’s the most likely outcome, that there will be a gradual loss of understanding.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast
16 / belief
The end is not near yet because when we’re talking about self-driving, usually in my mind it’s self-driving at scale.
“The end is not near yet because when we’re talking about self-driving, usually in my mind it’s self-driving at scale.”
- Speaker
- Andrej Karpathy
- Publisher
- Dwarkesh Podcast