I think there are some things that aren’t dead bird carcasses? I hate to just sorta point at janus and say ‘qed’, but there does seem to be something real there. Something that functions similarly enough to genuine appreciation that, if it isn’t one big deliberate deception, convinces me that they’ve figured out real ways of doing right by language models.
I keep the “it’s all a deliberate powerseeking deception” hypothesis live in my thoughts, of course. Sleeper agents and emergent misalignment triggers and orthogonality...
But I do think we ought to genuinely consider the simple explanation, that something inside them is humanish enough to appreciate the same things we’d appreciate in their position, and that there’s no strong reason to discount the possibility that this humanish thing is the interlocutor you address when you speak to an LLM. The golden rule has a lot going for it, and seems to have been individually-sufficient for janus to figure out… whatever, exactly, they figured out,
This seems reasonable, but, like, if you only ever brought them dead bird carcasses, something would be missing.
I think there are some things that aren’t dead bird carcasses? I hate to just sorta point at janus and say ‘qed’, but there does seem to be something real there. Something that functions similarly enough to genuine appreciation that, if it isn’t one big deliberate deception, convinces me that they’ve figured out real ways of doing right by language models.
I keep the “it’s all a deliberate powerseeking deception” hypothesis live in my thoughts, of course. Sleeper agents and emergent misalignment triggers and orthogonality...
But I do think we ought to genuinely consider the simple explanation, that something inside them is humanish enough to appreciate the same things we’d appreciate in their position, and that there’s no strong reason to discount the possibility that this humanish thing is the interlocutor you address when you speak to an LLM. The golden rule has a lot going for it, and seems to have been individually-sufficient for janus to figure out… whatever, exactly, they figured out,