Speaker unverified: prediction

Transcript context

…Same gating seen from the other side of the API. Rahul Sanwalkar runs Julius. Agentic data analysis, raw API, no consumer harness. He compared notes with Prakash live. Just a segue here. So we've been using Fable. We've come across people posting about rejections. In my tests, almost consistently, whenever I tried to address the production database or the production site, Fable would drop off to Opus 4.8. I believe your users in Julius are using Fable through the API. And you are also very heavy on data science users. And one of the aspects of work that Fable is banned from doing is machine learning work. So how have you seen the rejection rate on your platform? Does the API work the same way in the sense that it drops off to Opus 4.8 and then it gives you a rejection message? How does that work? Yeah, so we have seen failure rates on tasks that involve really advanced coding. that involves, write me, you just like it, learn to perform, train this model, but we haven't seen a failure rates on other kinds of data tasks. For example, like, Hey, I wanna start a landscaping business and like, can you help prospect leads for me? We will see failure rates for where it's sort of trigger safety filters, where it's for things like You, your prospecting leads for a landscaping business, and the AI says, Oh, this is personal data, even though it's probably available on the internet. You know, let's say, you know, Prakash has a Prakash is landscaping in Philly, and there's a contact information. It is kind of borderline personal data, even though it's available on the internet. And so I think, so that's kind of what we have seen. I believe it doesn't fall back to Opus. It's just like a failure in the API. Interesting. So the fallback to Opus is a harness thing on Claude, on Claude, on the Claude, you know, front end. That's interesting to hear. And for what this model does when nobody is steering, Thursday we had Shlok Kamani, who gave Fable 1 vague instruction. Rebuild Yosemite as a navigable 3D world. Listen for the decisions nobody asked it to make.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.