Evidence receipt / evaluation
Published · transcript-backedAlessio Fanelli: evaluation
12 Mar 2026 Latent Space Retrieval After RAG: Hybrid Search, Agents, and Database Design — Simon Hørup Eskildsen of Turbopuffer
“From a workload perspective, you’re thinking this is gonna be like a read heavy thing because they’re doing recommend.”
Source trail
Everything needed to verify it.
- Speaker
- Alessio Fanelli
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 12 Mar 2026
- Publisher
- Latent Space
Transcript context
…Yes. Yes. And then, and you would build this, this file, right? It’s just like ultra simplistic, but it’s not a far shot from what the first version of Turbo Buffer was. Why hasn’t anyone done that in that moment? From a workload perspective, you’re thinking this is gonna be like a read heavy thing because they’re doing recommend. Like is the fact that like writes are so expensive now? Oh, with ai you’re actually not writing that much. At that point I hadn’t really thought too much about, well no actually it was always clear to me that there was gonna be a lot of rights because at Shopify, the search clusters were doing, you know, I don’t know, tens or hundreds of crew QPS, right? ‘cause you just have to have a human sit and type in. But we did, you know, I don’t know how many updates there were per second. I’m sure it was in the millions, right into the cluster. So I always knew there was like a 10 to 100 ratio on the read write. In the read wise use case. It’s, um, even, even in the read wise use case, there’d probably be a lot fewer reads than writes, right? There’s just a lot of churn on the amount of stuff that was going through versus the amount of queries. Um, I wasn’t thinking too much about that. I was mostly just thinking about what’s the fundamentally cheapest way to build a database in the cloud today using the primitives that you have available. And this is it, right? You just, now you have one machine and you know, let’s say you have a terabyte of data in S3, you paid the $200 a month for that, and then maybe five to 10% of that data and needs to be an NV ME SSDs and less than that in dram. Well. You’re paying very, very little to inflate the data.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.