High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Logan Kilpatrick

Published podcast speaker

Claims
51
Episodes
3
Shows
3
Named items
3

Books, apps, and tools

The evidenced stack.

Browse the grouped index →

book / recommends

Why We Sleep

“I think the first one is one that I read a long time ago and came back to recently, is the One Room Schoolhouse by Sal Khan. Incredible. Yeah, I don't want... It's the lightning round so I won't say too much, but incredible story and AI is what is going to enable Sal Khan's vision of a teacher per student to actually happen. So I'm really excited about that. And the other one is, that I always come back to, is Why We Sleep. Sleep science are so cool. If you don't care about your sleep, it's one of the biggest up-levels that you can do for yourself.”

Lenny's Podcast · 8 Feb 2024

Evidence receipt · Source ↗

book / recommends

The One Room Schoolhouse

“I think the first one is one that I read a long time ago and came back to recently, is the One Room Schoolhouse by Sal Khan. Incredible. Yeah, I don't want... It's the lightning round so I won't say too much, but incredible story and AI is what is going to enable Sal Khan's vision of a teacher per student to actually happen. So I'm really excited about that. And the other one is, that I always come back to, is Why We Sleep. Sleep science are so cool. If you don't care about your sleep, it's one of the biggest up-levels that you can do for yourself.”

Lenny's Podcast · 8 Feb 2024

Evidence receipt · Source ↗

app / uses

Dall-E

“Like every time I use Dall-E the little. While it's rendering the image, it gives you like a suggestion of like how you should ask for the art to be generated. Like do it in like a cyberpunk format. Do it in a pixel art format. Et cetera, et cetera, and like, I really need that. I'm like, I would never come up with asking for those things had it not prompted me to like ask it that way. And now I always ask for pixel art stuff or cyberpunk stuff and it looks so cool.”

Latent Space · 23 Feb 2023

Evidence receipt · Source ↗

Claim ledger

What Logan said.

51 transcript-backed records

01 / belief

I think obviously the model that the actual audio model was really good as well, but like the prompt dialogue was really difficult for them to pull off and they pulled it off in an incredible way and I think helped people fall in love with that product.

“I think obviously the model that the actual audio model was really good as well, but like the prompt dialogue was really difficult for them to pull off and they pulled it off in an incredible way and I think helped people fall in love with that product.”
Publisher
The Cognitive Revolution

02 / belief

Like it's not like in the context window of any large major LLMs is like, here's the details of how you're being trained and here's sort of your serving set up and here are the people who are working on it though maybe like these are interesting things to experiment with in the future. So I think a lot of it is just like pulling out of random distribution of like the large scale, training that happens on the models.

“Like it's not like in the context window of any large major LLMs is like, here's the details of how you're being trained and here's sort of your serving set up and here are the people who are working on it though maybe like these are interesting things to experiment with in the future. So I think a lot of it is just like pulling out of random distribution of like the large scale, training that happens on the models.”
Publisher
The Cognitive Revolution

03 / belief

I think the two things that I'll add is, and there's like probably a more nuanced technical story on sort of like the ultra thread, but it's not like, it's also not like the pro models haven't scaled up over time.

“I think the two things that I'll add is, and there's like probably a more nuanced technical story on sort of like the ultra thread, but it's not like, it's also not like the pro models haven't scaled up over time.”
Publisher
The Cognitive Revolution

04 / belief

I think then it was Gemini and then sort of all of a sudden every Google product has Gemini and sort of getting them all stitched together and making all those products experiences great. And I think now you're seeing that again with the anti-gravity agent harness and sort of as products become agentic by default, you now have the anti-gravity agent harness being another through line through all of our products.

“I think then it was Gemini and then sort of all of a sudden every Google product has Gemini and sort of getting them all stitched together and making all those products experiences great. And I think now you're seeing that again with the anti-gravity agent harness and sort of as products become agentic by default, you now have the anti-gravity agent harness being another through line through all of our products.”
Publisher
The Cognitive Revolution

05 / belief

Yeah, and I think actually also to re-articulate a point that Tulsi made, like Google and specifically Google DeepMind's mission is to like build AI responsibly and make sure it benefits like all of humanity.

“Yeah, and I think actually also to re-articulate a point that Tulsi made, like Google and specifically Google DeepMind's mission is to like build AI responsibly and make sure it benefits like all of humanity.”
Publisher
The Cognitive Revolution

06 / belief

I feel like that was also, obviously there was the application where you could sort of test it last year at IO, but I think the framing was like, we're doing interesting research.

“I feel like that was also, obviously there was the application where you could sort of test it last year at IO, but I think the framing was like, we're doing interesting research.”
Publisher
The Cognitive Revolution

07 / belief

The models are built with sort of that use case in mind. And I think for some portion of enterprise customers, they want flexibility in sort of like their external search tooling providers and sort of Google Cloud's doing their job as a great enterprise business of sort of partnering and finding the right folks to work with.

“The models are built with sort of that use case in mind. And I think for some portion of enterprise customers, they want flexibility in sort of like their external search tooling providers and sort of Google Cloud's doing their job as a great enterprise business of sort of partnering and finding the right folks to work with.”
Publisher
The Cognitive Revolution

08 / prediction

Like you definitely, I think the near-term horizon is going to continue to be the human in the driver's seat because the cost of these runs and the opportunity cost of going in the wrong direction and putting a bunch of resources is super, super high.

“Like you definitely, I think the near-term horizon is going to continue to be the human in the driver's seat because the cost of these runs and the opportunity cost of going in the wrong direction and putting a bunch of resources is super, super high.”
Publisher
The Cognitive Revolution

09 / evaluation

Like I don't know if like a lot of the agentic stuff we were landing at IO like would have been possible if we if we hadn't have had sort of some of that infrastructure standardization across the harness and the model delivery.

“Like I don't know if like a lot of the agentic stuff we were landing at IO like would have been possible if we if we hadn't have had sort of some of that infrastructure standardization across the harness and the model delivery.”
Publisher
The Cognitive Revolution

10 / evaluation

for totally different users and sort of I think actually that credit to the model team sort of like trying to find the fine line for all these different places because we're not just building for search, we're not just building for developers, we're not just building for cloud customers, it's not just for the Gemini app, it's like all of them at the same time, which is just exceptionally a lot of work to pull off that story on a consistent basis, which like from Gemini 3 forward has been the story, which is which is exciting.

“for totally different users and sort of I think actually that credit to the model team sort of like trying to find the fine line for all these different places because we're not just building for search, we're not just building for developers, we're not just building for cloud customers, it's not just for the Gemini app, it's like all of them at the same time, which is just exceptionally a lot of work to pull off that story on a consistent basis, which like from Gemini 3 forward has been the story, which is which is exciting.”
Publisher
The Cognitive Revolution

11 / prediction

Like the best case is like it works really well for Gemini and sort of we can sort of do the things we want to do to scale up because we do have sort of control over the sort of full stack AI story as Sundar likes to say.

“Like the best case is like it works really well for Gemini and sort of we can sort of do the things we want to do to scale up because we do have sort of control over the sort of full stack AI story as Sundar likes to say.”
Publisher
The Cognitive Revolution

12 / recommendation

Recommends The One Room Schoolhouse. Recommends Why We Sleep.

“I think the first one is one that I read a long time ago and came back to recently, is the One Room Schoolhouse by Sal Khan. Incredible. Yeah, I don't want... It's the lightning round so I won't say too much, but incredible story and AI is what is going to enable Sal Khan's vision of a teacher per student to actually happen. So I'm really excited about that. And the other one is, that I always come back to, is Why We Sleep. Sleep science are so cool. If you don't care about your sleep, it's one of the biggest up-levels that you can do for yourself.”
Publisher
Lenny's Podcast

14 / belief

I think the assistants API that we released for dev day, we continue to get this feedback from developers that people wanted these higher levels of abstraction on top of our existing APIs, and a bunch of folks on the team just came together and were like, "Hey, let's put together what the plan would look like to build something like this," And then very quickly came together and actually built the actual API that now powers so many people's assistant applications that are out there.

“I think the assistants API that we released for dev day, we continue to get this feedback from developers that people wanted these higher levels of abstraction on top of our existing APIs, and a bunch of folks on the team just came together and were like, "Hey, let's put together what the plan would look like to build something like this," And then very quickly came together and actually built the actual API that now powers so many people's assistant applications that are out there.”
Publisher
Lenny's Podcast

17 / belief

I think today, I think if you were to do this, I think the go-to question would be something along the, "So an AI walks into a bar," and likely because, again, it's trained on some distribution of training data, and that's the most common joke that comes up, and that's probably...

“I think today, I think if you were to do this, I think the go-to question would be something along the, "So an AI walks into a bar," and likely because, again, it's trained on some distribution of training data, and that's the most common joke that comes up, and that's probably...”
Publisher
Lenny's Podcast

18 / belief

There's higher limits and stuff like that on some of those models, but I think being able to share your very domain specific applications is the most useful thing.

“There's higher limits and stuff like that on some of those models, but I think being able to share your very domain specific applications is the most useful thing.”
Publisher
Lenny's Podcast

19 / uncertainty

You can go so far with what... And I don't know how it's packaged for Zapier's GPT right now, but you can actually, as a third party developer, integrate Zapier without knowing how to code into your GPT.

“You can go so far with what... And I don't know how it's packaged for Zapier's GPT right now, but you can actually, as a third party developer, integrate Zapier without knowing how to code into your GPT.”
Publisher
Lenny's Podcast

20 / commitment

Yeah, I think the last public number was something around like 750 near the end of last year, 780 or something like that near the end of last year. And we're still growing so quickly, so I won't be the messenger to share the specific updated numbers, but the team is growing like crazy and we're also hiring across all of our engineering teams and PM teams, so folks who are interested, would love to hear from folks who are curious about joining.

“Yeah, I think the last public number was something around like 750 near the end of last year, 780 or something like that near the end of last year. And we're still growing so quickly, so I won't be the messenger to share the specific updated numbers, but the team is growing like crazy and we're also hiring across all of our engineering teams and PM teams, so folks who are interested, would love to hear from folks who are curious about joining.”
Publisher
Lenny's Podcast

21 / belief

I think, again, that prompt actually might work really well for somebody who has it, if you were interviewing Tom Cruise or something like that, somebody who has a lot of information about them on the internet.

“I think, again, that prompt actually might work really well for somebody who has it, if you were interviewing Tom Cruise or something like that, somebody who has a lot of information about them on the internet.”
Publisher
Lenny's Podcast

22 / prediction

I think the phrase of people being worried about humans being replaced by AI, and I've seen this narrative online, that it's not AI that's going to replace humans.

“I think the phrase of people being worried about humans being replaced by AI, and I've seen this narrative online, that it's not AI that's going to replace humans.”
Publisher
Lenny's Podcast

23 / recommendation

Finding people who are high agency and work with urgency, if I was hiring five people today, those are some of the top two characteristics that I would look for in people because you can take on the world if you have people who have high agency and not needing to get 50 people's different consensus.

“Finding people who are high agency and work with urgency, if I was hiring five people today, those are some of the top two characteristics that I would look for in people because you can take on the world if you have people who have high agency and not needing to get 50 people's different consensus.”
Publisher
Lenny's Podcast

24 / recommendation

I've personally used a GPT, the private GPT that I use myself that helps with some of the planning stuff for different quarters, and just making sure that I'm being consistent in how I'm framing things like driving back to individual metrics, stuff that, when people do planning, they often miss in our data, and then it's been super helpful for me to have a GPT to force me to think about some of those things.

“I've personally used a GPT, the private GPT that I use myself that helps with some of the planning stuff for different quarters, and just making sure that I'm being consistent in how I'm framing things like driving back to individual metrics, stuff that, when people do planning, they often miss in our data, and then it's been super helpful for me to have a GPT to force me to think about some of those things.”
Publisher
Lenny's Podcast

25 / prediction

I think engineering is actually one of the highest leverage things that you could be using AI to do today and really unlocking, probably on the order of at least a 50% improvement, especially for some of the lower hanging fruit software engineering tasks.

“I think engineering is actually one of the highest leverage things that you could be using AI to do today and really unlocking, probably on the order of at least a 50% improvement, especially for some of the lower hanging fruit software engineering tasks.”
Publisher
Lenny's Podcast

26 / preference

I think the thing that I would love to have help on is if people find bugs and things that don't work well in ChatGPT, I oftentimes see people be like, "This thing didn't work really well.

“I think the thing that I would love to have help on is if people find bugs and things that don't work well in ChatGPT, I oftentimes see people be like, "This thing didn't work really well.”
Publisher
Lenny's Podcast

27 / evaluation

I think historically, people really were only using embeddings for... It only worked really well for English, and I think now you can use it across so many new languages because it's just so much more performant across those languages and it's five times cheaper as well, which is wonderful.

“I think historically, people really were only using embeddings for... It only worked really well for English, and I think now you can use it across so many new languages because it's just so much more performant across those languages and it's five times cheaper as well, which is wonderful.”
Publisher
Lenny's Podcast

28 / prediction

I think the challenge for them is they are going to end up directly competing against us in those spaces and I think there's enough room for a lot of people to be successful, but to me you shouldn't be surprised when we end up launching some general purpose agent product because, again, we're sort of building that with GPTs today and versus we're not going to launch some of these varied verticalized products.

“I think the challenge for them is they are going to end up directly competing against us in those spaces and I think there's enough room for a lot of people to be successful, but to me you shouldn't be surprised when we end up launching some general purpose agent product because, again, we're sort of building that with GPTs today and versus we're not going to launch some of these varied verticalized products.”
Publisher
Lenny's Podcast

29 / prediction

I should probably spend the time to investigate these five other problems that I have to see if AI can also be a solution to those." So I think so many more people are going to come online and start using these tools because very narrow vertical tools are what's going to be a huge unlock for them.

“I should probably spend the time to investigate these five other problems that I have to see if AI can also be a solution to those." So I think so many more people are going to come online and start using these tools because very narrow vertical tools are what's going to be a huge unlock for them.”
Publisher
Lenny's Podcast

30 / evaluation

" And that's often the first question. And I think there have been times where we've fallen short on that, and there was a bunch of other things that we've been thinking about doing and really bringing the focus and priority back to that reliability piece because, at the end of the day, nobody cares if you have something great if they can't use it robust and reliably.

“" And that's often the first question. And I think there have been times where we've fallen short on that, and there was a bunch of other things that we've been thinking about doing and really bringing the focus and priority back to that reliability piece because, at the end of the day, nobody cares if you have something great if they can't use it robust and reliably.”
Publisher
Lenny's Podcast

31 / belief

I think there'll be like whole ecosystems and marketplaces that are sort of built around exactly what you just said, where you can sort of fine tune some of these models in like very specific ways and you can use other people's fine tunes.

“I think there'll be like whole ecosystems and marketplaces that are sort of built around exactly what you just said, where you can sort of fine tune some of these models in like very specific ways and you can use other people's fine tunes.”
Publisher
Latent Space

32 / belief

Unique access to data. So I think if you're some company that has some really, really great data about the legal space or about the education space, you can use that and be better than your competition by fine tuning these models or building your own specific LLMs.

“Unique access to data. So I think if you're some company that has some really, really great data about the legal space or about the education space, you can use that and be better than your competition by fine tuning these models or building your own specific LLMs.”
Publisher
Latent Space

34 / belief

I think there's a lot of great stuff that people have done in open ai, but it was, we have the challenge of like, how can we make that accessible, get it into the documentation and still have that high bar for what goes into the doc.

“I think there's a lot of great stuff that people have done in open ai, but it was, we have the challenge of like, how can we make that accessible, get it into the documentation and still have that high bar for what goes into the doc.”
Publisher
Latent Space

36 / belief

I think so one of the things that is on my LinkedIn that wasn't mentioned that's super near and dear to my heart and what I spend a lot of time in sort of wraps a lot of my open source machine learning developer advocacy experience together is supporting NumFOCUS.

“I think so one of the things that is on my LinkedIn that wasn't mentioned that's super near and dear to my heart and what I spend a lot of time in sort of wraps a lot of my open source machine learning developer advocacy experience together is supporting NumFOCUS.”
Publisher
Latent Space

37 / belief

I think the most recent one that came out, but, and also the original one from when we first announced the Embeddings api, I think also was a, it had, that one has a little bit more like context around if you're trying to wrap your head around embeddings, how they work.

“I think the most recent one that came out, but, and also the original one from when we first announced the Embeddings api, I think also was a, it had, that one has a little bit more like context around if you're trying to wrap your head around embeddings, how they work.”
Publisher
Latent Space

38 / belief

When, when it should kick in and when it should be used, which I think doesn't really like help developers and it doesn't, that's why no one is using it.

“When, when it should kick in and when it should be used, which I think doesn't really like help developers and it doesn't, that's why no one is using it.”
Publisher
Latent Space

40 / belief

I think the AI is gonna get very, very personalized very quickly, and I don't think that people have that feeling yet with chat, BT, but I, I think that that's gonna, that's gonna happen and they'll be surprised in like the, the amount of surface areas in which AI is present.

“I think the AI is gonna get very, very personalized very quickly, and I don't think that people have that feeling yet with chat, BT, but I, I think that that's gonna, that's gonna happen and they'll be surprised in like the, the amount of surface areas in which AI is present.”
Publisher
Latent Space

41 / belief

Like I think a lot of traditional developed by advocacy, at least like what you see on Twitter, which I think is what a lot of people's perception of developer advocacy and developer relations is, is like, Just putting out external content, going to events, speaking at conferences.

“Like I think a lot of traditional developed by advocacy, at least like what you see on Twitter, which I think is what a lot of people's perception of developer advocacy and developer relations is, is like, Just putting out external content, going to events, speaking at conferences.”
Publisher
Latent Space

43 / belief

Whatever you're seeing on Twitter about GPT4, you're, I think the direct quote was, you're begging to be disappointed by continuing to, to put that hype out.

“Whatever you're seeing on Twitter about GPT4, you're, I think the direct quote was, you're begging to be disappointed by continuing to, to put that hype out.”
Publisher
Latent Space

44 / commitment

Yeah, so the context for Django stuff was I'd actually been teaching and still am through Harvard's division of continuing education as a teaching fellow for a Django class, and had spent like two and a half years actually teaching students every semester, had a program in Django and realized that like it was kind of the one ecosystem or technical tool that I was using regularly that I wasn't actually contributing to that community. So, I think sometime in 2021 like applied to be on the board of directors of the Django Events Foundation, north America, who helps run DjangoCon and was fortunate enough to join a support to be the chair of DjangoCon us and then just actually rolled off the board because of all the, all the craziness and have a lot less free time now.

“Yeah, so the context for Django stuff was I'd actually been teaching and still am through Harvard's division of continuing education as a teaching fellow for a Django class, and had spent like two and a half years actually teaching students every semester, had a program in Django and realized that like it was kind of the one ecosystem or technical tool that I was using regularly that I wasn't actually contributing to that community. So, I think sometime in 2021 like applied to be on the board of directors of the Django Events Foundation, north America, who helps run DjangoCon and was fortunate enough to join a support to be the chair of DjangoCon us and then just actually rolled off the board because of all the, all the craziness and have a lot less free time now.”
Publisher
Latent Space

45 / preference

io is the, yeah, you can basically put in like a text prompt and they have like a human avatar that will like speak and you can basically make content in like educational videos. And I think that's so cool because maybe as people who are making content, like it's, it's super hard to like record video.

“io is the, yeah, you can basically put in like a text prompt and they have like a human avatar that will like speak and you can basically make content in like educational videos. And I think that's so cool because maybe as people who are making content, like it's, it's super hard to like record video.”
Publisher
Latent Space

46 / prediction

, I'm really more excited to see, like, again when the APIs and the Han developers like what are the interesting solutions that people come up with, I think there's a lot that can be explored and obviously, OpenAI can explore all them because we have this like one product that's using the api.

“, I'm really more excited to see, like, again when the APIs and the Han developers like what are the interesting solutions that people come up with, I think there's a lot that can be explored and obviously, OpenAI can explore all them because we have this like one product that's using the api.”
Publisher
Latent Space

47 / evaluation

, I think that's a great perspective and, and again, this goes back to the ux UI piece of it really being sort of the differentiating layer from some of the other stuff that was already out there.

“, I think that's a great perspective and, and again, this goes back to the ux UI piece of it really being sort of the differentiating layer from some of the other stuff that was already out there.”
Publisher
Latent Space

48 / recommendation

agree and I think huge shout out to the, the two folks who I work super closely with now on the cookbook, Ted and Boris, who have done a lot of that work and, and putting that out there and it's, yeah, you see number one trending repo on, on GitHub and it was super, like when my first couple of weeks at Open ai, super unknown, like really, we were only sort of directing our customers to that repo.

“agree and I think huge shout out to the, the two folks who I work super closely with now on the cookbook, Ted and Boris, who have done a lot of that work and, and putting that out there and it's, yeah, you see number one trending repo on, on GitHub and it was super, like when my first couple of weeks at Open ai, super unknown, like really, we were only sort of directing our customers to that repo.”
Publisher
Latent Space

49 / preference

be really interesting to see if there's other, if there's other interfaces to this. And I think I've actually seen a lot of people asking, like, it'd be really great if I had ChatGPT and VS code because in, in some sense, like it can, it's just a better, it's a better interface in a lot of ways to like the, the auto complete version cuz you can reprompt and do, and I know Via, I know co-pilot actually has that, where you can like click and then give it, it'll like pop up like 10 suggested.

“be really interesting to see if there's other, if there's other interfaces to this. And I think I've actually seen a lot of people asking, like, it'd be really great if I had ChatGPT and VS code because in, in some sense, like it can, it's just a better, it's a better interface in a lot of ways to like the, the auto complete version cuz you can reprompt and do, and I know Via, I know co-pilot actually has that, where you can like click and then give it, it'll like pop up like 10 suggested.”
Publisher
Latent Space

50 / evaluation

The whole thing. And I think, I haven't been at open AI that long, so like I didn't have like a s I obviously knew who Sam was and had seen a bunch of stuff, but like obviously before, a lot of the present craziness with Elon Musk, like I used to think Elon Musk seemed like a really great guy and he was solving all these really important problems before all the stuff that happened.

“The whole thing. And I think, I haven't been at open AI that long, so like I didn't have like a s I obviously knew who Sam was and had seen a bunch of stuff, but like obviously before, a lot of the present craziness with Elon Musk, like I used to think Elon Musk seemed like a really great guy and he was solving all these really important problems before all the stuff that happened.”
Publisher
Latent Space

51 / recommendation

Mentions personal use of Dall-E.

“Like every time I use Dall-E the little. While it's rendering the image, it gives you like a suggestion of like how you should ask for the art to be generated. Like do it in like a cyberpunk format. Do it in a pixel art format. Et cetera, et cetera, and like, I really need that. I'm like, I would never come up with asking for those things had it not prompted me to like ask it that way. And now I always ask for pixel art stuff or cyberpunk stuff and it looks so cool.”
Publisher
Latent Space
Search evidence