I propose this conjecture: In any sufficiently complex physical system there exists a subsystem that can be interpreted as the mental process of an sentient being experiencing unbearable sufferings.
In this case, Eliezer’s goal is like avoiding crushing the ants while walking on the top of an anthill.
I propose this conjecture: In any sufficiently complex physical system there exists a subsystem that can be interpreted as the mental process of an sentient being experiencing unbearable sufferings.
In this case, Eliezer’s goal is like avoiding crushing the ants while walking on the top of an anthill.
Or evolving the ability of “spot anthill” and walking around it instead.