High Signal Podcasts Evidence ledger
Method
Browse
How the evidence works

Public evidence record

Alex Volkov

Published podcast speaker

Claims
27
Episodes
6
Shows
1
Named items
0

Claim ledger

What Alex said.

27 transcript-backed records

01 / uncertainty

Why can't advanced voice mode sing? And as a follow up to this, if it's a company, like, legal issue in terms of corporate, et cetera, Is there a daylight between how you think about safety in terms of your own products, on your own platform, Versus giving us developers kind of the I don't know, sign the right things off so we can, we can make our voice not sing.

“Why can't advanced voice mode sing? And as a follow up to this, if it's a company, like, legal issue in terms of corporate, et cetera, Is there a daylight between how you think about safety in terms of your own products, on your own platform, Versus giving us developers kind of the I don't know, sign the right things off so we can, we can make our voice not sing.”
Speaker
Alex Volkov
Publisher
Latent Space

02 / evaluation

yeah. So, we'll see, but I wanted to highlight the speed because you started with like within a week the first alpaca or, implementation and change in Axelot came and now like you're talking about like three days and that's with you flying and that's with you like presenting and talking on podcasts.

“yeah. So, we'll see, but I wanted to highlight the speed because you started with like within a week the first alpaca or, implementation and change in Axelot came and now like you're talking about like three days and that's with you flying and that's with you like presenting and talking on podcasts.”
Speaker
Alex Volkov
Publisher
Latent Space

03 / evaluation

Nobody liked it. It's really, so first of all, nobody liked it, but secondly, only the people who were able to find compute enough to run inference on this, they only had like, I can't run this on my laptop, and so that's why it's much easier, something like OpenRMS 7 to be, 7B, it's much easier, because you can run this on your MacBook.

“Nobody liked it. It's really, so first of all, nobody liked it, but secondly, only the people who were able to find compute enough to run inference on this, they only had like, I can't run this on my laptop, and so that's why it's much easier, something like OpenRMS 7 to be, 7B, it's much easier, because you can run this on your MacBook.”
Speaker
Alex Volkov
Publisher
Latent Space

04 / evaluation

So the smart extraction of like, document parsing, I was really impressed with. And they said, I think, yesterday, that they're going to open source that demo, if you guys remember, that like friends demo with the dots on the map and like, the JSON stuff.

“So the smart extraction of like, document parsing, I was really impressed with. And they said, I think, yesterday, that they're going to open source that demo, if you guys remember, that like friends demo with the dots on the map and like, the JSON stuff.”
Speaker
Alex Volkov
Publisher
Latent Space

05 / belief

I think you'll have to get some news people to actually speak, like, about the mission, about the actual product, but as far as I understand this no matter how much the product side will be, and there will likely be, there's so many people that are doing, like, so incredible stuff that people notice, like, you know so no matter how, like, how much of the business side will be, they're, like, committed to fully open source as much as possible, including data sets, including models that are, like, TraceMasters, for example, their model that's like trained on the occult and the physical and metaphysical, you can't expect OpenAI to let you.

“I think you'll have to get some news people to actually speak, like, about the mission, about the actual product, but as far as I understand this no matter how much the product side will be, and there will likely be, there's so many people that are doing, like, so incredible stuff that people notice, like, you know so no matter how, like, how much of the business side will be, they're, like, committed to fully open source as much as possible, including data sets, including models that are, like, TraceMasters, for example, their model that's like trained on the occult and the physical and metaphysical, you can't expect OpenAI to let you.”
Speaker
Alex Volkov
Publisher
Latent Space

07 / belief

A very important question everybody was asking, did the five people who got the 500 first got actually 1, 000? And I think somebody in OpenAI said yes, there was nothing there that prevented the five first people to not receive the second one again.

“A very important question everybody was asking, did the five people who got the 500 first got actually 1, 000? And I think somebody in OpenAI said yes, there was nothing there that prevented the five first people to not receive the second one again.”
Speaker
Alex Volkov
Publisher
Latent Space

08 / belief

Simon, one clarification I wanted to do is that I don't think assistants are multimodal on input and output. So you do have vision, I believe.

“Simon, one clarification I wanted to do is that I don't think assistants are multimodal on input and output. So you do have vision, I believe.”
Speaker
Alex Volkov
Publisher
Latent Space

09 / belief

If you hit the API, get the whole thread back, then count the tokens. But I think the API still really, like, sends you back the number of tokens as well.

“If you hit the API, get the whole thread back, then count the tokens. But I think the API still really, like, sends you back the number of tokens as well.”
Speaker
Alex Volkov
Publisher
Latent Space

10 / evaluation

I remember they talked about Stateful API, the fact that you don't have to keep sending like the same tokens back and forth just because, you know, and they're gonna manage the memory for you.

“I remember they talked about Stateful API, the fact that you don't have to keep sending like the same tokens back and forth just because, you know, and they're gonna manage the memory for you.”
Speaker
Alex Volkov
Publisher
Latent Space

11 / evaluation

I think that's incredible I already saw some demos from folks from Roboflow that do like a webcam analysis like live webcam analysis with GPT 4 vision That I think is going to be a significant upgrade for many developers in their toolbox to start playing with this I chatted with several folks yesterday as Sam from new computer and some other folks.

“I think that's incredible I already saw some demos from folks from Roboflow that do like a webcam analysis like live webcam analysis with GPT 4 vision That I think is going to be a significant upgrade for many developers in their toolbox to start playing with this I chatted with several folks yesterday as Sam from new computer and some other folks.”
Speaker
Alex Volkov
Publisher
Latent Space

12 / prediction

Interesting to that if I do like a recap for a month, the beginning of the month, most of the updates don't matter, because like every, every, This, Yeah, nobody's gonna look at your notes, they're gonna have a GPT trained on your notes answering everything.

“Interesting to that if I do like a recap for a month, the beginning of the month, most of the updates don't matter, because like every, every, This, Yeah, nobody's gonna look at your notes, they're gonna have a GPT trained on your notes answering everything.”
Speaker
Alex Volkov
Publisher
Latent Space

13 / belief

AI apparently had early access to this and now released a a, I think open source, like full open source toolkit to fine tune mosaic and which is now Databricks also chime in, but it's now super simple to fine tune LAMA on their you know, infrastructure.

“AI apparently had early access to this and now released a a, I think open source, like full open source toolkit to fine tune mosaic and which is now Databricks also chime in, but it's now super simple to fine tune LAMA on their you know, infrastructure.”
Speaker
Alex Volkov
Publisher
Latent Space

14 / belief

We've seen this with a two, two line change that you can, you can make Lama forget about the context it was trained on, and there was back and forth about how effective this is and whether or not it suffers from the same dip, you know, in the middle of the context. But this rope scaling trick then was verified by folks from, I think Microsoft, independently from that guy Kaiko, Ken Devrel, and I, I see some folks in the audience here who are participating in this.

“We've seen this with a two, two line change that you can, you can make Lama forget about the context it was trained on, and there was back and forth about how effective this is and whether or not it suffers from the same dip, you know, in the middle of the context. But this rope scaling trick then was verified by folks from, I think Microsoft, independently from that guy Kaiko, Ken Devrel, and I, I see some folks in the audience here who are participating in this.”
Speaker
Alex Volkov
Publisher
Latent Space

15 / preference

I think for, for languages, and I've tried and my go-to like vibe check with these models is to, with the, especially the open source one is the ability to translate, the ability to understand the languages.

“I think for, for languages, and I've tried and my go-to like vibe check with these models is to, with the, especially the open source one is the ability to translate, the ability to understand the languages.”
Speaker
Alex Volkov
Publisher
Latent Space

16 / evaluation

Now the big thing is we have commercial licensing, but the amount of people, I don't know if you guys noticed, but like the amount of people who signed, quote unquote in support of releasing these models, Paul Graham and Mark Andreesen, and like a bunch of other folks, like in addition to the model, they also released kind of a counterweight to the moratorium papers and all the AI safety stuff.

“Now the big thing is we have commercial licensing, but the amount of people, I don't know if you guys noticed, but like the amount of people who signed, quote unquote in support of releasing these models, Paul Graham and Mark Andreesen, and like a bunch of other folks, like in addition to the model, they also released kind of a counterweight to the moratorium papers and all the AI safety stuff.”
Speaker
Alex Volkov
Publisher
Latent Space

21 / recommendation

If you look up on top on the jumbotron, I think one of the first tweets there, there's a, a quick video for those of you, but like, if you don't want to just go to settings and ChatGPT, go to Beta features and enable code interpreter, just hit the, the little, little toggle there and you'll have access under GPT four, you'll have access to a new code interpreter able , which does amazing things.

“If you look up on top on the jumbotron, I think one of the first tweets there, there's a, a quick video for those of you, but like, if you don't want to just go to settings and ChatGPT, go to Beta features and enable code interpreter, just hit the, the little, little toggle there and you'll have access under GPT four, you'll have access to a new code interpreter able , which does amazing things.”
Speaker
Alex Volkov
Publisher
Latent Space

22 / belief

We've talked about yamo being maybe left tokens count overall over json and we all, we all tried this and I think we've all been begging up to kind of gi give us the stool.

“We've talked about yamo being maybe left tokens count overall over json and we all, we all tried this and I think we've all been begging up to kind of gi give us the stool.”
Speaker
Alex Volkov
Publisher
Latent Space

23 / uncertainty

Just real quick, Roy is the Devrel for Pine Kong and the example that we saw I don't know if how many of you folks had the chance to dive into the, to the cookbook, the OpenAI released.

“Just real quick, Roy is the Devrel for Pine Kong and the example that we saw I don't know if how many of you folks had the chance to dive into the, to the cookbook, the OpenAI released.”
Speaker
Alex Volkov
Publisher
Latent Space

24 / belief

I think the thing about these spaces is we, we don't have Logan here or anybody open, and when we do.

“I think the thing about these spaces is we, we don't have Logan here or anybody open, and when we do.”
Speaker
Alex Volkov
Publisher
Latent Space

25 / prediction

I, I expect amazing things once that drops for the ability of, you know, a GPT4 to understand the real world.

“I, I expect amazing things once that drops for the ability of, you know, a GPT4 to understand the real world.”
Speaker
Alex Volkov
Publisher
Latent Space

26 / preference

I think that's definitely a huge plus for, for folks who are not, you know, necessarily token price conscious at this point.

“I think that's definitely a huge plus for, for folks who are not, you know, necessarily token price conscious at this point.”
Speaker
Alex Volkov
Publisher
Latent Space

27 / evaluation

Super excited to see what people build with the 3 5 16 K model, because honestly, like we think GP PT four is just quite expensive at this point.

“Super excited to see what people build with the 3 5 16 K model, because honestly, like we think GP PT four is just quite expensive at this point.”
Speaker
Alex Volkov
Publisher
Latent Space
Search evidence