Evidence receipt / belief
Published · transcript-backedShawn Wang: belief
14 Dec 2023 Latent Space The "Normsky" architecture for AI coding agents — with Beyang Liu + Steve Yegge of SourceGraph
“Oh, yeah. So the context is that I think a lot of research shows that like one, context utilization matters based on model.”
Source trail
Everything needed to verify it.
- Speaker
- Shawn Wang
- Attribution
- Verified speaker
- Claim type
- belief
- Recorded
- 14 Dec 2023
- Publisher
- Latent Space
Transcript context
…I almost think of it as like a generalized search problem because it's a lot of the same things. Like you want your layer one to have high recall and get all the potential things that could be relevant. And then there's typically like a layer two re-ranking mechanism that bumps up the precision and tries to get the relevant stuff to the top of the results list. Have you discovered that ranking matters a lot? Oh, yeah. So the context is that I think a lot of research shows that like one, context utilization matters based on model. Like GPT uses the top of the context window, and then apparently Claude uses the bottom better. And it's lossy in the middle. Yeah. So ranking matters. No, it really does. The skill with which models are able to take advantage of context is always going to be dependent on how that factors into the impact on the training loss.…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.