disgust at utility maximization
I kind of find the entire notion of utility maximization in the Yudkowskian worldview to be gross. Essentially trying to turn the raw material of the entire universe into stuff that just tickles your primitive drives. It’s bad when a wrapper mind does it, it’s bad when anything does it. Fun theory refutes itself.
But at the same time, I don’t believe in liberalism, I don’t think resources should be allocated to other beings just because, or for the sake of preserving individual liberty. I see other humans as paperclippers. That is equally abhorrent to me, they’re the same thing, in fact.
Either way it’s the gross utility maximization thing. A transhuman utopia would just be some implementation of Fun Theory and it would convert the universe into stuff that tickles the primitive drives of humans.
There’s also something gross about a being which… acts desperately and selfishly for the sake of a utility function that only has meaning to it. “That last human child MUST be converted into paperclips. This is of the utmost importance.”
You wouldn’t wirehead an ant, so why would you try to give a human everything they want. Equally distasteful in a way.
Why are you adding the word “primitive” to your descriptions? Utility maximization should encompass ALL desires and drives, including the beautiful and holy. You can even include altruism—if you seek other’s satisfaction (or at least expressions thereof—you don’t have direct access to their experiences), that’s perfectly valid.
Because human utility functions are not just composed of “the beautiful and holy”. It would be hard to even disentangle the beautiful and holy from the primitive and selfish parts, since after all, they came from the same place, not like they’re fundamentally different. There is something unnatural, disturbing, abstractly distasteful to me about a being which artificially has its utility function maximized through powerful optimization, even if that being is myself. I gave the example of wireheading an ant.
Hmm. I’m not sure what you’re disgusted by. If the complaint is that humans (all/most?) aren’t pure, and have motives that seem gross and base, you’re probably right, but also probably not well-served by being disgusted—finding beauty in imperfection or just curiosity about what makes us tick might be better. That said, I’m not one to yuck your … yuck.
If the complaint is that utility theory is itself gross because it allows it, I don’t agree. It’s still a useful model, just that reality clashes with your preferences.
Do you have a positive vision for the future? For your own future?