I don’t think the difficulties in adapting our moral intuitions into a self-consistent formal system (e.g. the Repugnant Conclusion) is a problem of insufficient optimisation power per se, its more the case that there are multiple systems within the brain (morality, intuitions, logic) and these are not operating in perfect harmony. This doesn’t mean that each individual system is not working ok in its own way.
Surely designing an engine, or writing a novel, or (… you get the gist) are complex optimising problems with many constraints, and yet it seems that humans can at least approximately solve these problems far faster than brute-force trial and error.
AFAICT the UGC was saying that there exist insoluble problems, not that these problems are actually common. It seems to me like Godel’s incompleteness theorem - there are statements which are true but which cannot be proved, but this doesn’t mean that no statement can be proved, or that mathematics is pointless. At the end of the day regardless of whether or not the fundamental underpinning of mathematics are on shaky ground, or whether there are unprovble theorems and unsolvable problems, the actual mathematics that allows us to build aeroplanes works, and the planes fly.
I don’t think the difficulties in adapting our moral intuitions into a self-consistent formal system (e.g. the Repugnant Conclusion) is a problem of insufficient optimisation power per se, its more the case that there are multiple systems within the brain (morality, intuitions, logic) and these are not operating in perfect harmony. This doesn’t mean that each individual system is not working ok in its own way.
Surely designing an engine, or writing a novel, or (… you get the gist) are complex optimising problems with many constraints, and yet it seems that humans can at least approximately solve these problems far faster than brute-force trial and error.
AFAICT the UGC was saying that there exist insoluble problems, not that these problems are actually common. It seems to me like Godel’s incompleteness theorem - there are statements which are true but which cannot be proved, but this doesn’t mean that no statement can be proved, or that mathematics is pointless. At the end of the day regardless of whether or not the fundamental underpinning of mathematics are on shaky ground, or whether there are unprovble theorems and unsolvable problems, the actual mathematics that allows us to build aeroplanes works, and the planes fly.