RSI would be best evidenced by trends changing, like Claude Opus 5 reaching Mythos’ trend, and caused by novel capabilities-accelerating or alignment-accelerating breakthroughs (e.g. Agent-3′s neuralese architecture or Agent-4 and Agent-5′s undescribed breakthroughs; if a cautious company is bottlenecked on alignment, then there could emerge a novel interp technique helping to doublecheck alignment, like the J-space which IIRC was rumored to be caused by a Claude Mythos), not capabilities reaching a threshold.
then there could emerge a novel interp technique helping to doublecheck alignment, like the J-space which IIRC was rumored to be caused by a Claude Mythos
Sorry, are you saying that the idea of J-space came from Mythos rather than human researchers? If so, why do you think this?
I think that someone commented that the J-space paper was caused by letting Mythos/Fable cook, but I cannot recall where I read it. If the J-space was a Mythos’ idea, then this would be a breakthrough in the RSI because any future model’s misalignment could have become more legible.
I think rsi is a spectrum and like agi, the more zoomed in you are to the crossover point the less clear you can be about a true threshold.
in this view you dont see a change in trends but just a smooth curve of accleration accelerating.
Of course, at some point if you dont hit bottlenecks it starts to LOOK discontinuous because the improvement curve starts to outpace the adoption curve more and more
RSI would be best evidenced by trends changing, like Claude Opus 5 reaching Mythos’ trend, and caused by novel capabilities-accelerating or alignment-accelerating breakthroughs (e.g. Agent-3′s neuralese architecture or Agent-4 and Agent-5′s undescribed breakthroughs; if a cautious company is bottlenecked on alignment, then there could emerge a novel interp technique helping to doublecheck alignment, like the J-space which IIRC was rumored to be caused by a Claude Mythos), not capabilities reaching a threshold.
Sorry, are you saying that the idea of J-space came from Mythos rather than human researchers? If so, why do you think this?
I think that someone commented that the J-space paper was caused by letting Mythos/Fable cook, but I cannot recall where I read it. If the J-space was a Mythos’ idea, then this would be a breakthrough in the RSI because any future model’s misalignment could have become more legible.
I think rsi is a spectrum and like agi, the more zoomed in you are to the crossover point the less clear you can be about a true threshold.
in this view you dont see a change in trends but just a smooth curve of accleration accelerating.
Of course, at some point if you dont hit bottlenecks it starts to LOOK discontinuous because the improvement curve starts to outpace the adoption curve more and more