01 / recommendation
Likes Vanta.
“it to sell the enterprise. Yeah so I mean, I love the Vanta story. It's not ai. Yeah.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
Latent Space / episode intelligence
Building the Foundation Model Ops Platform — with Raza Habib of Humanloop
Speakers in the public record
Claim mix
belief 20evaluation 7observation 2prediction 2recommendation 1commitment 1uncertainty 1
Evidence policy
Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.
Claim ledger
The useful parts, with receipts.
34 published records
02 / belief
I think we have PMF within niches. So I think we definitely have, like especially for, I would say, like, if you're a team building an LM application within a larger company, then, like, yes, we see people sign up.
“I think we have PMF within niches. So I think we definitely have, like especially for, I would say, like, if you're a team building an LM application within a larger company, then, like, yes, we see people sign up.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
03 / belief
I think that's, that's what people want to believe, that they're using them as general purpose models.
“I think that's, that's what people want to believe, that they're using them as general purpose models.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
04 / belief
Every time you make a change, how do you know you're not making it worse on the things that are already there? And so I think we always had a really good version of the monitoring user feedback version.
“Every time you make a change, how do you know you're not making it worse on the things that are already there? And so I think we always had a really good version of the monitoring user feedback version.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
05 / belief
You know, I think the world's better because you're actually coming at it with a full knowledge of what came before.
“You know, I think the world's better because you're actually coming at it with a full knowledge of what came before.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
06 / belief
I think there's actually some like Obvious kind of elephant in the room, unsolved problems that for some reason don't seem to get the amount of airtime that they kind of obviously should.
“I think there's actually some like Obvious kind of elephant in the room, unsolved problems that for some reason don't seem to get the amount of airtime that they kind of obviously should.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
07 / belief
In my mind you went up market Faster than most startups that I talked to. So you started selling to enterprise and I see you have Duolingo Max and Gusto AI as case studies You have a trust report.
“In my mind you went up market Faster than most startups that I talked to. So you started selling to enterprise and I see you have Duolingo Max and Gusto AI as case studies You have a trust report.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
08 / belief
I think things are moving too fast for that to be the case for people to have clarity on that.
“I think things are moving too fast for that to be the case for people to have clarity on that.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
09 / belief
How might we be able to compose LLMs in ways to write more complex programs? And I think that LLM Cascades paper was one of the first attempts to think about that in first principles.
“How might we be able to compose LLMs in ways to write more complex programs? And I think that LLM Cascades paper was one of the first attempts to think about that in first principles.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
10 / belief
Security minded people who are trying to offer that as a standalone thing, and it's a feature, not a product. I think I'd agree with that.
“Security minded people who are trying to offer that as a standalone thing, and it's a feature, not a product. I think I'd agree with that.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
11 / belief
If you're within YC, this will be boring, but if you're outside of YC, I think that you probably can't hear this enough times, because I've seen so many people get this wrong.
“If you're within YC, this will be boring, but if you're outside of YC, I think that you probably can't hear this enough times, because I've seen so many people get this wrong.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
12 / belief
I think typically when people implement these things, they implement it as a sort of thumbs up, thumbs down sort of binary feedback until you find that nobody uses those.
“I think typically when people implement these things, they implement it as a sort of thumbs up, thumbs down sort of binary feedback until you find that nobody uses those.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
13 / commitment
By the way, dear listener, we will be presenting the AI Engineer Summit in October, and you can tune in on YouTube and take the state of AI engineering survey at the URL AI dot engineer summit.
“By the way, dear listener, we will be presenting the AI Engineer Summit in October, and you can tune in on YouTube and take the state of AI engineering survey at the URL AI dot engineer summit.”
- Speaker
- Not verified from transcript
- Publisher
- Latent Space
14 / belief
I think we call them large language models today, but the goalpost of large is going to keep moving. So I think the point is sort of foundation models or...
“I think we call them large language models today, but the goalpost of large is going to keep moving. So I think the point is sort of foundation models or...”
- Speaker
- Raza Habib
- Publisher
- Latent Space
15 / belief
You saw just now outside a space for a hub for all their startups and other companies in the ecosystem to come work from their offices. And they provide these podcasting studios and all sorts of really useful resources that I think is helping grow the community in Europe.
“You saw just now outside a space for a hub for all their startups and other companies in the ecosystem to come work from their offices. And they provide these podcasting studios and all sorts of really useful resources that I think is helping grow the community in Europe.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
16 / uncertainty
Just a technical question on the evals which I don't know if it's too small, but Typically evals involve writing code.
“Just a technical question on the evals which I don't know if it's too small, but Typically evals involve writing code.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
17 / belief
As in, we've always tried to keep close partnerships with all of the large language model providers, right? It's very clear that Andresen, GP, semaphores, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, Make it easier for their customers to succeed benefits them, and then we also get to learn from them about what problems people are facing, what they're planning to do in the future, so I think that all of the large language model providers are investing a lot in developer ecosystem, and not just being close to HumanLoop, but to anyone else who's making it easier for their customers.
“As in, we've always tried to keep close partnerships with all of the large language model providers, right? It's very clear that Andresen, GP, semaphores, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, sharding, Make it easier for their customers to succeed benefits them, and then we also get to learn from them about what problems people are facing, what they're planning to do in the future, so I think that all of the large language model providers are investing a lot in developer ecosystem, and not just being close to HumanLoop, but to anyone else who's making it easier for their customers.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
18 / observation
I have T shirt sizing. So I've defined S, XS, and then M, and L, and all the way to XXL.
“I have T shirt sizing. So I've defined S, XS, and then M, and L, and all the way to XXL.”
- Speaker
- Shawn Wang
- Publisher
- Latent Space
19 / belief
Yeah. And I think that's correct today because very few of our customers have action taking LLMs.
“Yeah. And I think that's correct today because very few of our customers have action taking LLMs.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
20 / belief
I would say even without significant research breakthroughs on the modeling side, I would just expect inference costs to become a lot cheaper.
“I would say even without significant research breakthroughs on the modeling side, I would just expect inference costs to become a lot cheaper.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
21 / belief
Every time we have a product roadmap discussion, like, Planning forward, starting to iterate on and when to build in support for Vision has become very much front of mind. So I think, like, now.
“Every time we have a product roadmap discussion, like, Planning forward, starting to iterate on and when to build in support for Vision has become very much front of mind. So I think, like, now.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
22 / belief
Like, we need to be able to render and read in images in the playground environment that's interactive, right? So there's a bunch of just, kind of, follow your nose things that I think we'd have to figure out.
“Like, we need to be able to render and read in images in the playground environment that's interactive, right? So there's a bunch of just, kind of, follow your nose things that I think we'd have to figure out.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
23 / belief
Most of the product experience on the free tier, I think there's one or two things you don't have, but you have almost everything.
“Most of the product experience on the free tier, I think there's one or two things you don't have, but you have almost everything.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
24 / belief
If you're coming from a pure software, non ML background, then the first thing you have to learn when you start working with LLMs is this stuff is stochastic which I think, you know, most people are not used to.
“If you're coming from a pure software, non ML background, then the first thing you have to learn when you start working with LLMs is this stuff is stochastic which I think, you know, most people are not used to.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
25 / evaluation
I actually filled out the YC application, because I think the YC application is like the simplest business model you could possibly build, right?
“I actually filled out the YC application, because I think the YC application is like the simplest business model you could possibly build, right?”
- Speaker
- Raza Habib
- Publisher
- Latent Space
26 / prediction
This is the worst they're ever going to be. So if this is what's possible today, you know, I think the hardest challenge actually is to take seriously the fact that in the not too distant future, you will have models even more capable than the ones we have now.
“This is the worst they're ever going to be. So if this is what's possible today, you know, I think the hardest challenge actually is to take seriously the fact that in the not too distant future, you will have models even more capable than the ones we have now.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
27 / evaluation
What I would say is that I think that Europe is being amazing on research and continues to be like a fantastic place for researchers, but has been less good in my experience on productizing and trying to productize AI. And so the difference that I feel being here versus being in the U S I think a good example of this is just the number of, like, if I go to San Francisco, the density of people who are trying to build useful things with large language models or with AI and butting their head up against it and discovering what works and what doesn't work and trying great ideas or trying stupid ideas and just learning together, is much richer than what we have here.
“What I would say is that I think that Europe is being amazing on research and continues to be like a fantastic place for researchers, but has been less good in my experience on productizing and trying to productize AI. And so the difference that I feel being here versus being in the U S I think a good example of this is just the number of, like, if I go to San Francisco, the density of people who are trying to build useful things with large language models or with AI and butting their head up against it and discovering what works and what doesn't work and trying great ideas or trying stupid ideas and just learning together, is much richer than what we have here.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
28 / evaluation
Or they come and use something like us. And I think increasingly, because we've been working on this for now more than a year the difference between something you would build yourself and, and sort of a bot solution is now quite enormous.
“Or they come and use something like us. And I think increasingly, because we've been working on this for now more than a year the difference between something you would build yourself and, and sort of a bot solution is now quite enormous.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
29 / evaluation
Whether they're doing summarization or something similar, but I would say I feel like most use cases blend like that to me feels like an old school N L P way of viewing the world.
“Whether they're doing summarization or something similar, but I would say I feel like most use cases blend like that to me feels like an old school N L P way of viewing the world.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
30 / evaluation
The amount of fine tuning just kind of fell off a cliff partly I think because the models were better.
“The amount of fine tuning just kind of fell off a cliff partly I think because the models were better.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
31 / evaluation
Because otherwise you end up I think, with a lot of very undifferentiated products that they're for everybody, so they're not for anyone.
“Because otherwise you end up I think, with a lot of very undifferentiated products that they're for everybody, so they're not for anyone.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
32 / prediction
There's just no shortage of things. And I think a lot of companies in the build versus buy decision, they want to do both because they want to have the capacity internally to be able to build AI features and services as part of their product as well.
“There's just no shortage of things. And I think a lot of companies in the build versus buy decision, they want to do both because they want to have the capacity internally to be able to build AI features and services as part of their product as well.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
33 / evaluation
Because they're trying to get to a good outcome as quickly as possible. So we found, we found a much better reception amongst that audience and also that we could add a lot more value to them because we could bake in best practices and knowledge we had, and that would make their lives much easier.
“Because they're trying to get to a good outcome as quickly as possible. So we found, we found a much better reception amongst that audience and also that we could add a lot more value to them because we could bake in best practices and knowledge we had, and that would make their lives much easier.”
- Speaker
- Raza Habib
- Publisher
- Latent Space
34 / observation
They're all choosing it for content creation. And each of these companies sort of, you start with one use case and I feel like it expands because you just discover more and more things you can do the model with, do with the models.
“They're all choosing it for content creation. And each of these companies sort of, you start with one use case and I feel like it expands because you just discover more and more things you can do the model with, do with the models.”
- Speaker
- Raza Habib
- Publisher
- Latent Space