I think… there’s more to this wrongness-feeling I have than I’ve expressed. I would readily subject a million forks of myself to horrific suffering for the moderate benefit of just one of me. The main reason I’d have reservations about releasing myself on the internet for anyone to download would be because they could learn how to manipulate me. The main problem I have with slavery and starvation is that they’re a waste of human resources, and that monolithic power structures are brittle against black swans. In short, I don’t consider it a moral issue what algorithm is computed to produce a particular result.
I think… there’s more to this wrongness-feeling I have than I’ve expressed. I would readily subject a million forks of myself to horrific suffering for the moderate benefit of just one of me. The main reason I’d have reservations about releasing myself on the internet for anyone to download would be because they could learn how to manipulate me. The main problem I have with slavery and starvation is that they’re a waste of human resources, and that monolithic power structures are brittle against black swans. In short, I don’t consider it a moral issue what algorithm is computed to produce a particular result.
I’m not sure how to formalize this properly.