Nathan Labenz: belief

Transcript context

…I actually don't watch the public benchmarks as closely. We do have internal series of benchmarks that watch very closely in terms of quality and latency for the tasks that we're optimizing for, which is, of course, built on top of the models that we get from the model providers. Whenever there's a new model that's about to be released, we'll go run out our tests, figure out what's improving, what are the gaps, and that I watch very closely. One thing that is maybe unique to Snowflake, of course, is we have a lot of tabular data. And that technology so far has been all about text to SQL and semantic models. So watch that space quite carefully. And there are some new trends happening in that space. These tabular foundation models are interesting. Being able to quickly build forecasting models and so forth are now possible. So those are other trends that I watch as well. Yeah, that's an interesting one. There's a few public forecasting like benchmarks and competitions. I think those are really interesting too. At the point where the models are better able to predict the future than our best super forecasters or even aggregations of super forecasters, that will feel, I think, like a very meaningful shift in what's going on in the world. Any contrarian takes? Anything you think like the, anything you want to correct that you think the audience at large might be misled or misconceiving right now. I mean, we touched upon the one that's very top of mind for me right now. I think the way we build products is changing. I don't think it's contrarian, but I don't think it's happening fast enough. We're at a point where how we build products needs to radically change. And that means change of behavior, because we've been trained to build products one way. So to me, that's the biggest one. In a world where these coding agents are such kind of capable platforms, how do you build new products? And in my mind, it is all about kind of starting with that first and then validating things quickly before you build a product in the first place.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.