Jeff Dean: belief

Transcript context

…Uh, yeah, cool. Uh, it’s, uh, I have a side interest in linguistics. I, I, I did, uh, uh, a few classes back in college and like, uh, part of me, like if I was a linguist and I could have access to all these models, I would just be asking really fundamental questions about language itself. Yeah. Like, uh, one is th there’s one very obvious one, which is Sapir-Whorf, like how much does like the language that you speak affect your thinking, but then also there’s some languages where there’s just concepts that are not represented in other languages, but some others, many others that are just duplicates, right. Where, uh, there’s also another paper that people love called the platonic representation where, you know, like the, the, an image of a cup is, uh, if you say learn a model on that and you, you, you have a lot of texts with the word cup eventually maps to it, like roughly the same place. And so like that should apply to languages except where it doesn’t. And that’s actually like very interesting differences in what humanity has discovered as concepts that maybe English doesn’t have. I don’t know. It’s just like my, my rant on languages. Yeah. I mean, I, I did some work on a early model that fused together a language based model with you have, you know, nice word based representations and then an image model where you have. Trained it on image net like things. Yes. And then you fuse together the top layers of, uh, no, this is devise, uh, uh, the, you do a little bit more training to fuse together those representations. And what you found was that if you give a novel image that is not in any of the categories in the image model, it was trained on the model can often assigns kind of the right cat, the right label to that image. Um, so for example, um, I think, uh, telescope and, uh, binoculars were both in the training, uh, categories for the image model, but, um, microscope was not. Hmm. And so if you’re given an image of a microscope, it actually can come up with something that’s, uh, got the word microscope as the label that it assigns, even though it’s never actually seen an image labeled that. Oh, that’s nice. That’s kind of cool. Yeah.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.