Speakers in the public record
Claim mix
belief 17uncertainty 8evaluation 6commitment 4recommendation 2preference 1
Evidence policy
Every row below preserves an exact excerpt. Identified speakers are linked; unresolved voices are labeled and excluded from people counts.
Claim ledger
The useful parts, with receipts.
38 published records
“I think Hyungwon is without going into detail, I still spend a lot of time talking to Hyungwon, even like in the, even after we both are different places, about like very interesting algorithm, arithmetic ways to think about life.”
- Publisher
- Latent Space
“I think. Okay. The last part that makes me uncomfortable about MOE debate is actually it's related to another paper that you wrote about the efficiency misnomer, in the sense that, like, now people are trying to make the debate all about the active parameters rather than total parameters.”
- Publisher
- Latent Space
“I imagine it's sensitive. But also in my mind this is now the most And this is the most valuable on the job training in the world.”
- Publisher
- Latent Space
“I think the second thing I learned from Jason is more about like, from my you know, kind of like, from my own career, it's like, the importance of like marketing and PR.”
- Publisher
- Latent Space
“We can make this the ending conversation, which is, I think you're an inspiration to a lot of other people who want to follow your career path, and, you know, I'm really glad that we got the chance to, like, walk through your career a bit.”
- Publisher
- Latent Space
“I also think that the, the, the Mirage paper is mostly like I don't know who, actually I don't even remember who wrote it.”
- Publisher
- Latent Space
“I think in retrospect, you understand now that this is a very valuable experience. And I think now, today, it will be much more competitive to get the job that you got, whereas you didn't, you know, two years ago, you didn't have to try that hard to get it.”
- Publisher
- Latent Space
“I will put myself on the other, so your mirror image, which is like, long context is good for prototyping, but any production system will just move to RAG.”
- Publisher
- Latent Space
“Like how do you, like, from the start of like, you haven't trained anything yet and you're about to kick off the run, like, are you able to like call your shots and say, we will beat GP 3.”
- Publisher
- Latent Space
“I don't know if you have a view on it, but it's just, like, it should be known to be hard.”
- Publisher
- Latent Space
“I don't, unfortunately, I don't know enough to push back on this, but on the surface of it, it seems to make sense.”
- Publisher
- Latent Space
“Oh, you probably get more gains from, from more, more than eight, I think. But like, I think in general it's like.”
- Publisher
- Latent Space
“I don't know if you know, the post money valuation, or the pre money valuation is public.”
- Publisher
- Latent Space
“I think you addressed this in your post, but the temptation would have been just to run everything on TPUs.”
- Publisher
- Latent Space
“I don't know how it turned from my, from my background to like, talking about the meta.”
- Publisher
- Latent Space
“In fact, I will try to be as I don't really say like, okay, you need to learn Jax, you need to learn this.”
- Publisher
- Latent Space
“Oh, no, no. So, so, so TPUs outside Google and t inside Google are probably very different things, I think.”
- Publisher
- Latent Space
“I, I, I don't know if you have commentary on whether this is obvious to you or this is the, this is the way, or they'll just be, they'll coexist.”
- Publisher
- Latent Space
“You got a whole bunch of GPUs. I think you disclosed somewhere, but I don't remember the exact number.”
- Publisher
- Latent Space
“I don't know how much, how many evals you want to do, right? Like, I do think Andre Capalti mentioned that.”
- Publisher
- Latent Space
“Funding, for startups, incubation, holding academic conferences, I think iClear next year is going to be in Singapore, so people come here and get exposed to it.”
- Publisher
- Latent Space
“I think always the way to go. Is it like a hundred experts, a thousand experts , for some reason the, the community settled on eight.”
- Publisher
- Latent Space
“Like, I think, Okay, like, fundamentally, I just think that MOEs are just, like, the way to go in terms of, like, flop parameters.”
- Publisher
- Latent Space
“Like, I think Making those are important, and for the community to heal crime, but I think long context is important, it's just that you don't have a very good way to measure them properly now, and yeah, I mean, I think long context is definitely the future, rather than RAC, but I mean, they could be used in conjunction.”
- Publisher
- Latent Space
“Sorry, I, I should have used that word. So like, you know, I don't know if you have any commentary on like ra, deep seek Snowflake Quinn all these proliferation of Moe e models that seem to all be spars op cycle because, you know, you, you were advisor on, on the spars op cycling paper.”
- Publisher
- Latent Space
“Rather than like, I pay like, like one cent and then like get back a wrong answer. So I think that's like, that is actually very easy to show that RAC is better than long context because there are a lot of tasks that don't need this long context.”
- Publisher
- Latent Space
“Mm-Hmm. and I put OS pretty low because I think you have a good base model and then you upcycle it and it bumps you a little bit.”
- Publisher
- Latent Space
“I think that you navigate the meta very well, and part of my goal here is to also isolate how you think about the meta for other people to reflect on, because I think obviously you do it very well.”
- Publisher
- Latent Space
“I think there's a couple, I agree with you fundamentally that like, it's actually quite easy to tell, like when you see a paper, okay, this one doesn't work, this one works, this one doesn't work.”
- Publisher
- Latent Space
“Because I feel like, I'll pick on Palm 2 and Emergence, because I really want to make sure I tell those stories.”
- Publisher
- Latent Space
“all the changes, all the changes that, like, Swiglu was this, like, okay, Swiglu is probably one of my favorite papers of all time, just because of the divine benevolence, like, the Noam (Shazeer) actually wrote, like we owe this success to divine benevolence, like, that was, like, it's always a meme thing, right?”
- Publisher
- Latent Space
“Like, just because you re parameterize some benchmarks in evals and, you know, make it linear, doesn't mean emergence is completely gone.”
- Publisher
- Latent Space
“I think inefficiency misnomer was like, we found that a lot of people, like, they use params, like, especially, like, like, to the kind of, like, right, and then MOEs was not very hot, like, in the community at that time, right, but MOEs were, like, a thing long ago. So I think using active params, I'm comfortable with using active params to kind of approximate like cost of the model, but like in the efficiency misnomer paper, we actually made it quite clear that you should always look holistically about like, because you have serving, like additional serving costs, like fitting in the GPUs, like fitting on single node, and something like that.”
- Publisher
- Latent Space
“Like, or So it's a very interesting observation where like, most efficiency work is just busy work, or like, it's work at a small scale that doesn't, that just ignores the fact that like, this thing doesn't scale, because you haven't scaled it.”
- Publisher
- Latent Space
“I mean, at the end of the day, I think research is still Like fundamentally like, we, as an industry, RIS, you still write papers, your goal is to advance science and everything.”
- Publisher
- Latent Space
“So I, okay, I won't be able to comment about like exactly our setup, but like, I think encoder decoder are kind of very misunderstood from thing, right?”
- Publisher
- Latent Space
“I think whenever possible, like early fusion is better, I think there will still be a lot of work steps.”
- Publisher
- Latent Space
“Rules like that, mantras that you've developed for yourself where you're like, okay, I must do this. So for example, recently for me, I've been trying to run my life on calendar for a long time, and I found that the only way that I work is I write things down on pen and paper, and I cross them off individually.”
- Publisher
- Latent Space