Public evidence record
Published podcast speaker
Claim ledger
5 transcript-backed records
01 / evaluation
“We had browsing as another feature in it although we ended up deemphasizing that later on because the model's internal knowledge was so good.”
02 / evaluation
“I would say there's a decent amount of room for variation in exactly how you do the training process.”
03 / evaluation
“There are some algorithms that work this way, like mixture models or multiplicative weight update algorithms, where you have—I don’t want to say mixture of experts because it means something different—basically a weighted combination of experts with some learned gating.”
04 / evaluation
“We found that a tiny amount of data did the trick, even when you mixed it together with everything else.”
05 / evaluation
“To some extent, putting a lot of stuff into context will take you pretty far because we have really long context now.”