The examples in this comment are about “oops I had an idea that sounds good but is accidentally bad”. That’s a reasonable thing to worry about but doesn’t seem like the thing you were actually asking about. You wrote:
I don’t expect to be particularly good at coordinating with my perfect clones for example. I’m sure if you put me in a room with my perfect clone and a source of massive power (such as a controllable ASI), we’d beat each other half to death fighting for it.
This seems much more central, and indicates a major problem.
I’ve been confused around why I find it so hard to trust people and this discussion has made me a little less confused. There seem to be multiple reasons. Thank you for discussing so far.
I agree that that seems to be the biggest problem—even if someone shared all my beliefs and values—I would struggle to coordinate with them right now.
I am also dealing with a bunch of painful personal shit right now that might be affecting my ability to trust people or lead a happy/meaningful life. I don’t want to share too much about that on a public forum. (It could actually fuck up my life if I did.)
I know the standard advice is to go fix my personal shit before I think about the future of the world, but at some point I do need to figure out who to trust or not, and it’s going to have implications for both my personal and professional life, I can’t just cleanly separate the two.
The examples in this comment are about “oops I had an idea that sounds good but is accidentally bad”. That’s a reasonable thing to worry about but doesn’t seem like the thing you were actually asking about. You wrote:
This seems much more central, and indicates a major problem.
You are right.
I’ve been confused around why I find it so hard to trust people and this discussion has made me a little less confused. There seem to be multiple reasons. Thank you for discussing so far.
I agree that that seems to be the biggest problem—even if someone shared all my beliefs and values—I would struggle to coordinate with them right now.
I am also dealing with a bunch of painful personal shit right now that might be affecting my ability to trust people or lead a happy/meaningful life. I don’t want to share too much about that on a public forum. (It could actually fuck up my life if I did.)
I know the standard advice is to go fix my personal shit before I think about the future of the world, but at some point I do need to figure out who to trust or not, and it’s going to have implications for both my personal and professional life, I can’t just cleanly separate the two.