person / likes
Melanie Mitchell
“There there has been a bit of an obsession, I think, with, headline accuracy when we do evaluations so that I'm a huge fan of Melanie Mitchell, for example, when she speaks about construct validity.”
Public evidence record
Beth Barnes
Published podcast speaker
- Claims
- 13
- Episodes
- 1
- Shows
- 1
- Named items
- 1
Books, apps, and tools
The evidenced stack.
Claim ledger
What Beth said.
2 transcript-backed records
01 / observation
We actually ended up with a negative correlation between years of experience and, and and performance because, like, the the sort of people who are in network, like, our friends who are kind of doing really well, and the people who are more qualified were, like, actually not doing that great.
“We actually ended up with a negative correlation between years of experience and, and and performance because, like, the the sort of people who are in network, like, our friends who are kind of doing really well, and the people who are more qualified were, like, actually not doing that great.”
- Speaker
- Beth Barnes
- Publisher
- Machine Learning Street Talk
02 / observation
there is a sort of adversarial selection going on where people are trying to make some benchmark, like, cheaply subject to the constraint that current models do badly on it, which means you, you know, you can't use a lot of expensive human labor, it has to be something that's either automatically checkable or that you can, like, create with kind of cheap human labor.
“there is a sort of adversarial selection going on where people are trying to make some benchmark, like, cheaply subject to the constraint that current models do badly on it, which means you, you know, you can't use a lot of expensive human labor, it has to be something that's either automatically checkable or that you can, like, create with kind of cheap human labor.”
- Speaker
- Beth Barnes
- Publisher
- Machine Learning Street Talk