Nathan Labenz: belief

Transcript context

…To. Take in a bunch of these threads and just score them on a few different dimensions like originality, substantiveness, whatever. Doing a little querying on top of that could pull those things out and, and drop them into a kind of master writing sample doc. I could say, OK, 50,000 words or 200,000 words or whatever you need. I've kind of, I've got enough, but I, how can I bring the cream to the top? So that was one initial use of that, but then also another post processing I think, I'm not sure if this maybe came in like May or something when everybody was all of a sudden doing wikis was to one idea I had over time was OK, Now that I have this thing right and it comes from like 8 different sources. It has iMessage in there. I downloaded an app called Beeper, which gives me some problems to be totally honest, but like does a decent job of consolidating DMS across all platforms into a single thing. And it it has a desktop API so the the model can pull out from that messages from a bunch of different platforms. The idea I had for a long time was OK, if I have all this correspondence and it's just in one big BLOB, then I could go back in time and do summaries with some frequency. What I ended up landing on was roughly monthly summaries. For me, it was like a couple 100,000 tokens per month seemed to be the the average. And that would include like my contributions to the thread, but also what people had sent me. Or if it's a group chat, it could be mostly other people, but just occasionally me. Whatever, right. But the idea is to try to create a comprehensive picture of my digital life and then develop a prompt that takes those couple 100,000 tokens per month. Summarizes that basically you like an order of magnitude reduction takes it down from say 2 to 300 to 20 to 30,000 tokens, which is honestly still a lot like that gives you really nitty gritty coverage of what happened in your month or 20,000 tokens. That's a you get pretty low level there, you know description of a month and think about 1000 tokens per work day. Did you really have 1000 tokens? You know you could. Even do that again to get to 2000 right if you needed to.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.