That is besides my point. I think you can make it stable, but anyway.
up until the most vicious actor creates their preferred world in the whole light cone—which might well also involve lots of suffering
There are some reasons to think default trajectory, of pragmatic victor, just get this evolution-created world duplicated many more times. Might be the baseline you have to improve on. Torture clusters might be worse outcome borne of uhh large but not quite enough ability to steer the values of the agent(s) that dominate.
Whether it can be made stable is quite central to my models of how we steer toward a good result. So, how do you think it could be made stable? And in that process, could you also make a little rule “no involuntary torturing or killing or controlling sentient beings; otherwise do what thou wilt”.
By “stable” I meant “able to exist at all”, as opposed to be conquered / merged into a singleton or something similar. And I didn’t make a claim about the extent it’s likely, more about how desirable it is. And what (value based, not existential/pragmatic) problems you would have to deal with in such a state.
I don’t have a detailed plan / expectation on how exactly you could be working to achieve such a state. It just seems vaguely possible, I don’t think I can offer you any new insight on that.
That is besides my point. I think you can make it stable, but anyway.
There are some reasons to think default trajectory, of pragmatic victor, just get this evolution-created world duplicated many more times. Might be the baseline you have to improve on. Torture clusters might be worse outcome borne of uhh large but not quite enough ability to steer the values of the agent(s) that dominate.
Whether it can be made stable is quite central to my models of how we steer toward a good result. So, how do you think it could be made stable? And in that process, could you also make a little rule “no involuntary torturing or killing or controlling sentient beings; otherwise do what thou wilt”.
By “stable” I meant “able to exist at all”, as opposed to be conquered / merged into a singleton or something similar. And I didn’t make a claim about the extent it’s likely, more about how desirable it is. And what (value based, not existential/pragmatic) problems you would have to deal with in such a state.
I don’t have a detailed plan / expectation on how exactly you could be working to achieve such a state. It just seems vaguely possible, I don’t think I can offer you any new insight on that.