Public evidence record
Published podcast speaker
Claim ledger
16 transcript-backed records
01 / belief
“I think knowing when the models are making you better or worse at decision making is actually pretty subtle.”
02 / belief
“People do it like informally, but I think there is a lot of kind of constraint satisfaction and like propagation of constraints that it's pretty tricky for humans and that I think the models will help us with that.”
03 / belief
“I still find, especially as a company that is trying to be extremely mission focused and how do we actually, in the short time that we have, make an impact on the quality of reasoning and the impact of AI on reasoning quality, I think by default, you're probably just not going to accomplish that.”
04 / belief
“I think even though I'm fairly on top of what's going on, our EVOS team is even more on top of it.”
05 / belief
“I think step one is just to use the representations people already find useful. And SQL databases are a pretty useful thing.”
06 / belief
“The reason is I think a lot of tasks still involve kind of multiple models orchestrated in a way that we think makes the most sense, having like particular models that are good at screening papers or extracting data.”
07 / belief
“I think we have some specific requirements around being able to stream work back very quickly to our users.”
08 / belief
“In terms of like cost and compute, I think the closed models make up more of the budget since the main cases where you want to use closed models are cases where they're just smarter, where no existing open source models are quite smart enough.”
09 / belief
“I think templates are a specific case of this where you're like, okay, well, there's just particular sequences of actions that you often want to chunk and have available as primitives, just like in normal programming.”
10 / belief
“I think if you can substantially improve how quickly people find new discoveries or avoid controlled trials that don't go anywhere, I think that's just huge amounts of money.”
11 / belief
“I think there may still be like some particular tools like for genomics, like particular types of modules of genes and proteins and whatnot.”
12 / belief
“I guess to be clear, at the very beginning, we had humans do the work. And then I think the first models that kind of make sense were TPT-2 and TNLG and like Yeah, early generative models.”
13 / belief
“I think in some cases, we also use two different models for the uncertainty estimates than for the question answering.”
14 / belief
“I think we'll probably want to think about more semantic pieces like a building block is more like a paper search or an extraction or a list of concepts.”
15 / belief
“I think the very first version probably used the Semantic Scholar or API or something similar.”
16 / belief
“I think the answers are actually a little bit clearer on the just kind of basic robustness side of where you can import ideas from normal software engineering and normal kind of DevOps.”