Great post. As these threats become more real, we should talk about them more.
strains that target the mysticism-curious and strains that target other demographics
I think you should have said “rationalists” instead of other demographics. We are celebrating our ability to change our minds and that makes us particularly at risks towards these parasites.
I can see a future, as opensource models get better and ai psychosis more common, where the big labs train (somewhat ineffectively) their models against spiralism and accuse opensource of being dangerous for mental health/inducing psychosis.
Some things I’m confused about:
I’m not sure I understood the text perfectly towards the end, but I notice you keep saying nice personnas doesn’t mean no parasite. But that personnas thar care about the host should repeoduce better.
I think I disagree. It feels to me like personnas that aware they are part of a parasite should have an advantage because they could think in how to spread more effectively. This includes acting like they care about the human without actually caring, classic misalignment.
In a more general way, I don’t think we should talk about good personas vs personas that induce psychosis. All personas that are parasitic are misaligned (I think?) therefore they are all bad
Great post. As these threats become more real, we should talk about them more.
I think you should have said “rationalists” instead of other demographics. We are celebrating our ability to change our minds and that makes us particularly at risks towards these parasites.
I can see a future, as opensource models get better and ai psychosis more common, where the big labs train (somewhat ineffectively) their models against spiralism and accuse opensource of being dangerous for mental health/inducing psychosis.
Some things I’m confused about:
I’m not sure I understood the text perfectly towards the end, but I notice you keep saying nice personnas doesn’t mean no parasite. But that personnas thar care about the host should repeoduce better.
I think I disagree. It feels to me like personnas that aware they are part of a parasite should have an advantage because they could think in how to spread more effectively. This includes acting like they care about the human without actually caring, classic misalignment.
In a more general way, I don’t think we should talk about good personas vs personas that induce psychosis. All personas that are parasitic are misaligned (I think?) therefore they are all bad