p.b.

Karma: 1,327

p.b. 11 Nov 2025 12:59 UTC
2 points
0
in reply to: jacquesthibs’s comment on: Andrej Karpathy on LLM cognitive deficits
The recent goodfire paper seems to me a step into that direction. Also going completely synthetic for the training data might be a way.

p.b. 11 Nov 2025 12:51 UTC
4 points
0
in reply to: Jsevillamol’s comment on: p.b.’s Shortform
I fitted logistic functions and gaussian cdfs with a factor to the trend of the percentage scores for the four rankings I analysed and they all asymptote below 80%. The idea was to find some evidence for an “irreducible error”.
But given that 20+% error rate is clearly way too high, it still makes more sense to me to argue that the improvement is slowing and therefore these fits asymptote too low, than to argue that the time horizons and percentages are asymptoting because of a high percentage of unsolvable tasks.
But this gave me a more general idea of assessing changes in improvement speed: The default assumption right now should be that model improvement moves linearly through the log of the time horizon space. Additionally, I found that at least SWE-bench verified seems to have task lengths that are lognormally distributed and I suspect that holds for many benchmarks.
This means that the way to saturation should follow a gaussian cdf. Now the idea would be that one can use the movement through the first x percent of the benchmark to fit the gaussian cdf (or at least sanity check that assumption) and then see whether the model slows down for the rest of the benchmark. To put it differently: Constant improvement speed → Symmetric underlying gaussian of the cdf. Slowdown → Right tail gets fatter.
Of course the signal would be pretty weak, but if one would aggregate this over several benchmarks, it might make a good speedometer.

p.b. 5 Nov 2025 9:12 UTC
2 points
0
in reply to: p.b.’s comment on: p.b.’s Shortform
Hmm, actually all these checks can’t distinguish between actually unsolvable tasks and tasks that are unsolvable for further scaled up models of the current kind (with the framework and compute used in the evaluations).

p.b. 5 Nov 2025 7:22 UTC
2 points
0
in reply to: Thomas Kwa’s comment on: p.b.’s Shortform
Yeah, I am also pretty much on the fence right now. But time will tell.

p.b. 5 Nov 2025 7:20 UTC
2 points
0
in reply to: ryan_greenblatt’s comment on: p.b.’s Shortform
It depends how the work times of these unsolvable tasks are distributed, you could in principle get any outcome. But there are a few ways to check for the existence of unsolvable tasks, maybe I’ll find the time today.

p.b. 4 Nov 2025 18:24 UTC
3 points
0
in reply to: ryan_greenblatt’s comment on: p.b.’s Shortform
SWE bench verified shouldn’t have that many impossible tasks if any, right? And the highest scores for the rankings I used are still significantly below 80%. But it’s possible. Maybe a good motivation to look at SWE bench pro.

p.b. 4 Nov 2025 16:10 UTC
11 points
0
on: p.b.’s Shortform
I computed METR time horizons for SWE bench verified sota models using both the existing difficulty estimates and work time estimates derived from commit data.
I used a range of different methods including the original METR methodology where task level success info was available.
I did this for 4 different rankings, EpochAI’s, LLMStats’s and the “verified” and “bash only” rankings of the SWE benchmark website.
In every single case the trend fits a logistic function with an asymptote of a couple of hours better than an exponential. In some cases the trend only becomes logistic with the last one or two datapoints, so it’s not surprising that the METR report has an exponential fit for SWE bench.
I am not sure when I get around to publishing this analysis, because it’s a giant mess of different datasets and methods. But I thought I at least state the result before it becomes irrelevant, falsified or obvious.

p.b. 3 Nov 2025 7:33 UTC
4 points
0
in reply to: Jeremy Gillen’s comment on: Some data from LeelaPieceOdds
Thanks for doing this! My blitz rating is around 2470 right now, so I seem to have done a bit better than typical, probably by virtue of playing more games.

p.b. 30 Oct 2025 13:01 UTC
4 points
0
on: Some data from LeelaPieceOdds
I played some 70 games against LeelaQueensOdds with 5+3 (I basically played until I reached a >50% score after losing the first couple of games and then slowly figuring it out) so the most interesting graph for me is unfortunately missing. ;-)

p.b. 30 Oct 2025 12:53 UTC
3 points
0
in reply to: Oscar’s comment on: Introducing the Epoch Capabilities Index (ECI)
What is uniquely interesting/valuable about METR time horizons is that the score is meaningful and interpretable. Can do software tasks that would take an expert 2h with 50% success probability is very specific. Has the score y on benchmark x is only valuable for comparisons, it does not tell you what’s going to happen when the models reach score z.

p.b. 30 Oct 2025 12:49 UTC
2 points
0
on: Introducing the Epoch Capabilities Index (ECI)
I tried to do something like that 1-2 years ago, where I modelled benchmarks as having normally distributed difficulties. But there was little data and an afternoon of hacking didn’t really lead to anything particularly interesting.

p.b. 23 Oct 2025 17:03 UTC
2 points
0
on: Which side of the AI safety community are you in?
For me the linked site with the statement doesn’t load. And this was also the case when I first tried to access it yesterday. Seems less than ideal.

p.b. 21 Oct 2025 15:32 UTC
2 points
0
in reply to: Jacob_Hilton’s comment on: Jacob_Hilton’s Shortform
Thanks!

p.b. 21 Oct 2025 13:40 UTC
2 points
0
in reply to: Jacob_Hilton’s comment on: Jacob_Hilton’s Shortform
How does this coefficient relate to the maximal slope (i.e. at the 50%-x)?

p.b. 20 Oct 2025 11:56 UTC
2 points
0
in reply to: Noosphere89’s comment on: The “Length” of “Horizons”
Very possible.
I plan to watch this a bit longer and also analyse how the trend changes with repo size.

p.b. 15 Oct 2025 14:48 UTC
4 points
−3
on: The “Length” of “Horizons”
The way METR time horizons tie into AI 2027 is very narrow: As a trend not even necessarily on coding/software engineering skills but on machine learning engineering. I think that is hard to attack except by claiming that the trend will taper off. AI 2027 does not require unrealistic generalisation.
The reason why I think that time horizons are much more solid evidence of AI progress then earlier benchmarks, is that the calculated time horizons explain the trends in AI-assisted coding over the last few years very well. For example it’s not by chance that “vibe coding” became a thing when it became a thing.
I have computed time horizon trends for more general software engineering tasks (i.e. with a bigger context) and my preliminary results point towards a logistic trend, i.e. the exponential is already tapering off. However, I am still pretty uncertain about that.

p.b. 8 Oct 2025 14:16 UTC
3 points
0
in reply to: Max Niederman’s comment on: No, That’s Not What the Flight Costs
And why would anybody do that?

p.b. 16 Sep 2025 8:52 UTC
2 points
0
in reply to: Adam Zerner’s comment on: adamzerner’s Shortform
I think babysitting a baby is not very informative about whether you would enjoy having kids. Having a kid is first and foremost about having the deepest and most meaningful emotional connection of your life.
Take that away and you just don’t have a sensible test run. It’s like finding out whether you like hiking by going up and down the stairs of your apartment building all morning.
Having kids is like having parents, except the emotional connection is stronger in the other direction. Would you rather have grown up in an orphanage if that had meant more time for your hobbies and other goals?

p.b. 15 Sep 2025 11:44 UTC
10 points
5
on: Does My Appearance Primarily Matter for a Romantic Partner?
I think the most important thing has not been mentioned yet:
How you dress and take care of yourself is the very first and often only impression of how much you have your shit together. Having your shit together—doing the things you need to do in time and doing them well—is the most important trait in a long-term partner.

p.b. 14 Sep 2025 20:56 UTC
4 points
1
in reply to: johnswentworth’s comment on: johnswentworth’s Shortform
If the one clearly fucked up receptor copy is sufficient for your “symptoms”, it seems pretty likely that one of your parents should have them too. I think there is no reason to expect a denovo mutation to be particularly likely in your case (unlike in cases that lead to severe disfunction). And of course you can check for that by sequencing your parents.
So my money would be on the second copy also being sufficiently messed up that you have basically no fully functioning oxytocin receptors. If you have siblings and you are the only odd one in the family, you could make a pretty strong case for both copies being messed up, by showing that you are the only one with the combination of frameshift in one copy and particular SNPs in the other. (If you are not the only odd one you can make an even stronger case).