Public evidence record
Published podcast speaker
Claim ledger
11 transcript-backed records
01 / belief
“I would say right now, the top five models on our inference stack are probably all fine-tuned versions of open models.”
02 / belief
“You know, we are pushing to do that on training. And that is, you know, we think, if there was a sort of, you know, developer experience message, that's probably the big one is where you have enough flexibility.”
03 / belief
“We also have, I would say, over 20 big model builds happening on the platform, which are customer.”
04 / commitment
“You know, the value we get from doing specific optimization, even for, you know, what works well for a particular model on A100s with a particular bus versus H100s, it's a worthwhile investment for us. So we will go down fairly deep into a specific architecture and specific hardware.”
05 / prediction
“I would say the market is very tight still, and it's likely going to be this way for a while, is my sense that the demand for AI computing is just kind of ramped up very, very quickly, and it will take a while for supply to catch up.”
06 / belief
“I think on the inference stack, there are open source inference stacks which are pretty good and definitely today, it gives us a competitive advantage to have the best one.”
07 / belief
“I think you need to have some kind of a marketplace for figuring out how to get this, you know, data into models and have, I think we'll increasingly see more of that.”
08 / prediction
“I think that's a pretty important question because that really gives us a roadmap of where this industry should go.”
09 / evaluation
“I would say there is a lot more understanding around fine tuning now, like even the last six months, there are, you know, source tools, recipes, literature, podcasts, discord channels where people are figuring out and it really is in many ways, one of the successes of open source is you have small collectives of, you know, engineers who have created, who are now creating the top models on open source leaderboards.”
10 / evaluation
“You know, and from there, finding, you know, other folks in the network, I think there is generally a lot of excitement and philosophical alignment around what we are doing, which, you know, we publish papers, we publish open source libraries and code, we build open models.”
11 / commitment
“You know, we'll be sort of building this best-of-class hardware. So as there are other versions of these coming out later this year, we plan to have those in the fleet as well.”