Related worry that I’ve been meaning to ask about for a while:
Given that is there is still plenty of controversy over which types of unusual human minds to consider “pathological” instead of just rare variants, how is MIRI planning to decide which ones are included in CEV? My skin in the game: I’m one of the Autistic Spectrum people who feel like “curing my autism” would make me into a different person who I don’t care about. I’m still transhumanist; I still want intelligence enhancements, external boosts to my executive function and sensory processing on demand, and the ability to override the nastiest of my brain chemistry. But even with all of that I would still know myself as very different from neurotypicals. I naturally see the world in different categories that most, and I don’t think in anything like words or a normal human language. Maybe more relevantly, I have a far higher tolerance—even a need—for sphexishness, than most people of comparable intelligence to me.
Fun theory for me would be a little different, and I think that there really are a lot of people who would consider what I did with eternity to be somewhat sad and pathetic, maybe even horrifying. I think it could be an empathic uncanny valley effect or just an actual basic drive people have, to make everybody be the same. I’m worried that this could be an actual terminal value for some people that would hold up under reflective equilibrium.
I’m not too freaked out because I think the consensus is that since Autistic people already exist and some are happy, we should have a right to continue to exist and even make more of ourselves. But I actually believe that if we didn’t exist it would be right to create us, and I worry that most neurotypicals extrapolated volition would not create all the other variations on human minds that should exist but don’t yet.
If it matters, up to $1000 for MIRI this year could be at stake in answering this concern. I say this in a blatant and open effort to incentivize Eliezer etc. to answering me. I hope that I’m not out of line for waving money around like this, because this really is a big part of my choice about whether FAI is good enough. I really want to give what I can to prevent existential threats, but I consider a singularity overly dominated by neurotypicals to be a shriek.
If it matters, up to $1000 for MIRI this year could be at stake in answering this concern. I say this in a blatant and open effort to incentivize Eliezer etc. to answering me. I hope that I’m not out of line for waving money around like this, because this really is a big part of my choice about whether FAI is good enough.
Not out of line at all. You are encouraged to use economics like that.
Related worry that I’ve been meaning to ask about for a while:
Given that is there is still plenty of controversy over which types of unusual human minds to consider “pathological” instead of just rare variants, how is MIRI planning to decide which ones are included in CEV? My skin in the game: I’m one of the Autistic Spectrum people who feel like “curing my autism” would make me into a different person who I don’t care about. I’m still transhumanist; I still want intelligence enhancements, external boosts to my executive function and sensory processing on demand, and the ability to override the nastiest of my brain chemistry. But even with all of that I would still know myself as very different from neurotypicals. I naturally see the world in different categories that most, and I don’t think in anything like words or a normal human language. Maybe more relevantly, I have a far higher tolerance—even a need—for sphexishness, than most people of comparable intelligence to me.
Fun theory for me would be a little different, and I think that there really are a lot of people who would consider what I did with eternity to be somewhat sad and pathetic, maybe even horrifying. I think it could be an empathic uncanny valley effect or just an actual basic drive people have, to make everybody be the same. I’m worried that this could be an actual terminal value for some people that would hold up under reflective equilibrium.
I’m not too freaked out because I think the consensus is that since Autistic people already exist and some are happy, we should have a right to continue to exist and even make more of ourselves. But I actually believe that if we didn’t exist it would be right to create us, and I worry that most neurotypicals extrapolated volition would not create all the other variations on human minds that should exist but don’t yet.
If it matters, up to $1000 for MIRI this year could be at stake in answering this concern. I say this in a blatant and open effort to incentivize Eliezer etc. to answering me. I hope that I’m not out of line for waving money around like this, because this really is a big part of my choice about whether FAI is good enough. I really want to give what I can to prevent existential threats, but I consider a singularity overly dominated by neurotypicals to be a shriek.
Not out of line at all. You are encouraged to use economics like that.
Did MIRI answer you? I would expect them to have answered by now, and I’m curious about the answer.