Companies should publicly define the desired behavior of a model, including edge cases, to clarify whether issues are bugs or policy debates
One thing that we've been thinking about more and more is I think this was a great idea. Somebody here had like... It'd be nice to write out what the desired behavior of a model is, make that public take input on it. Say, here's how this model's supposed to behave and explain the edge cases too. And then when a model is not behaving in a way that you want, it's at least clear about whether that's a bug the company should fix or behaving as intended and you should debate the policy