Evidence receipt / evaluation
Published · transcript-backedWing Lian: evaluation
8 Dec 2023 Latent Space The Busy Person's Intro to Finetuning & Open Source AI - Wing Lian, Axolotl
“It tended to be, like, have relatively good answers, depending on who you ask, right? But, I think for me, it was just, Releasing models was a way to try and, like, continue to build out the product, figure out what I needed to put into the product, how do I make it faster, and, if you've got to, like, go and debug your product, you may as well have it do something useful.”
Source trail
Everything needed to verify it.
- Speaker
- Wing Lian
- Attribution
- Verified speaker
- Claim type
- evaluation
- Recorded
- 8 Dec 2023
- Publisher
- Latent Space
Transcript context
…Fantastic. Cool. Well, I think that's roughly highlights most of the open source universe. You also have your own models. Do you want to shout out any one of them? Yeah. I mean, I think like, I think Early on, Manicore got a lot of love. I think it was mostly popular in, like, the roleplay communities. It was, it tended to be pretty truthful. It tended to be, like, have relatively good answers, depending on who you ask, right? But, I think for me, it was just, Releasing models was a way to try and, like, continue to build out the product, figure out what I needed to put into the product, how do I make it faster, and, if you've got to, like, go and debug your product, you may as well have it do something useful. Awesome. So, yeah. Okay, and then maybe we'll talk about just fine tuning techniques. So this is going to be a little bit more technical than just talking about model names and datasets. So we started off talking about LoRa, QLoRa. I just learned from your readme there's ReLoRa. Which I've never heard about. Could you maybe talk about, like, just parameter efficient fine tuning that whole, that…
Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.