High Signal Podcasts Evidence ledger
Method
Browse
← Back to evidence

Evidence receipt / evaluation

Published · transcript-backed

Shawn Wang: evaluation

20 Sept 2024 Latent Space The Ultimate Guide to Prompting

“You've done very well. And I think you've honestly done the community a service by reading all these papers so that we don't have to, because the joke is often that, you know, what is one prompt is like then inflated into like a 10 page PDF that's posted on archive.”

— Shawn Wang

Source trail

Everything needed to verify it.

Speaker
Shawn Wang
Attribution
Verified speaker
Claim type
evaluation
Recorded
20 Sept 2024
Publisher
Latent Space

Transcript context

…And so we ran hack-a-prompt in May of 2023, but the paper from EMNLP came out a number of months later. Although I think we put it on archive first. And then the prompt report came out about two months ago. So kind of a yearly cadence of releases. You've done very well. And I think you've honestly done the community a service by reading all these papers so that we don't have to, because the joke is often that, you know, what is one prompt is like then inflated into like a 10 page PDF that's posted on archive. And then you've done the reverse of compressing it into like one paragraph each of each paper. So thank you for that. We saw some ridiculous stuff out there. I mean, some of these papers I was reading, I found AI generated papers on archive and I flagged them to their staff and they were like, thank you. You know, we missed these.…

Stored transcript either side of the excerpt. The highlighted words are the published quote; the surrounding text is unedited source, never generated.

Search evidence