observation · 17 Oct 2025 · 51:19

LLMs do not manipulate information in the same way humans do when reading a book.

When you're reading a book, I don't even feel like the book is exposition I'm supposed to be attending to and training on. The book is a set of prompts for me to do synthetic data generation, or for you to get to a book club and talk about it with your friends.

Watch at 51:19