High Signal Podcasts Evidence ledger
Method
Browse

Public evidence record

Michal Tesnar

Published podcast speaker

Claims
5
Episodes
1
Shows
1
Named items
0

Claim ledger

What Michal said.

5 transcript-backed records

02 / belief

I think ARC is an example for the case that you can do this, at least to some level, because we see the Frontier LLM scoring quite well on this end of day, wouldn't be able to if these core priors would be breaking it.

“I think ARC is an example for the case that you can do this, at least to some level, because we see the Frontier LLM scoring quite well on this end of day, wouldn't be able to if these core priors would be breaking it.”
Speaker
Michal Tesnar
Publisher
Machine Learning Street Talk

03 / preference

because there's so little time to learn and you really, if you wanna get the 100% which is the which is the grand prize, then you really you you have to outcompete a human which really can take a lot of time just to think.

“because there's so little time to learn and you really, if you wanna get the 100% which is the which is the grand prize, then you really you you have to outcompete a human which really can take a lot of time just to think.”
Speaker
Michal Tesnar
Publisher
Machine Learning Street Talk

04 / evaluation

Right? But that doesn't work because it doesn't really it cannot really it we have tried that and that has not really led to improvements because it doesn't really understand where the agent fails.

“Right? But that doesn't work because it doesn't really it cannot really it we have tried that and that has not really led to improvements because it doesn't really understand where the agent fails.”
Speaker
Michal Tesnar
Publisher
Machine Learning Street Talk

05 / evaluation

The question is whether this holds also for the for the withheld private test, but it seems that goal setting is not the bottlenecks, rather the action efficiency and the accumulation of the knowledge over a very long context because you need millions hundreds of thousands, if not millions of tokens to solve this.

“The question is whether this holds also for the for the withheld private test, but it seems that goal setting is not the bottlenecks, rather the action efficiency and the accumulation of the knowledge over a very long context because you need millions hundreds of thousands, if not millions of tokens to solve this.”
Speaker
Michal Tesnar
Publisher
Machine Learning Street Talk
Search evidence