Public evidence record
Published podcast speaker
Claim ledger
3 transcript-backed records
01 / recommendation
“Maybe we use some sort of reward model outside of this to select even the best one to preference, as well.”
02 / recommendation
“If you want to restrict them from having chips, you have to let them have at least some level of chip that is better than what they can build internally.”
03 / recommendation
“Unless you're fine tuning for on-device use, I think fine tuning current existing models, especially the smaller ones is a useless waste of time because the cost of inference is actually much cheaper than you think once you achieve good MBU and you batch at a decent size, which any successful business in the cloud is going to achieve, you know, and then two, fine tuning like people like, oh, you know, this 7 billion parameter model, if you fine tune it on a data set is almost as good as 3.”