Plus the process of a few hundred million years of evolutionary pressures.
Do you think simulating those years and extrapolating the derived values from that simulation is clearly easier and simpler than extrapolating the values from e.g. a study of human neural scans/human biochemistry/human psychology?
Do you think simulating those years and extrapolating the derived values from that simulation is clearly easier and simpler than extrapolating the values from e.g. a study of human neural scans/human biochemistry/human psychology?
It’s not clear to me how the second is obviously easier. How would you even do that? Are there simple examples of doing this that would help me understand what “extrapolating human values from a study of human neural scans” would entail?
One could e.g. run a sim of bounded intelligence agents competing with each other for resources, then pick the best one, that will implement the tit for tat and more complex solutions that work. It was already the case that for iterated prisoner’s dilemma there wasn’t some enormous number of amoral solutions, to the much surprise of AI researchers of the time who wasted their efforts trying to make some sort of nasty sneaky Machiavellian AI.
edit: anyhow i digress. The point is that when something is derivable via simple rules (even if impractical), like laws of physics, that should enormously boost the likehood that it is derivable in some more practical way.
Would “yes” be an acceptable answer? It probably is harder to run the simulations, but it’s worth a shot at uncovering some simple cases where different starting conditions converge on the same moral/decision making system.
Plus the process of a few hundred million years of evolutionary pressures.
Do you think simulating those years and extrapolating the derived values from that simulation is clearly easier and simpler than extrapolating the values from e.g. a study of human neural scans/human biochemistry/human psychology?
It’s not clear to me how the second is obviously easier. How would you even do that? Are there simple examples of doing this that would help me understand what “extrapolating human values from a study of human neural scans” would entail?
One could e.g. run a sim of bounded intelligence agents competing with each other for resources, then pick the best one, that will implement the tit for tat and more complex solutions that work. It was already the case that for iterated prisoner’s dilemma there wasn’t some enormous number of amoral solutions, to the much surprise of AI researchers of the time who wasted their efforts trying to make some sort of nasty sneaky Machiavellian AI.
edit: anyhow i digress. The point is that when something is derivable via simple rules (even if impractical), like laws of physics, that should enormously boost the likehood that it is derivable in some more practical way.
Would “yes” be an acceptable answer? It probably is harder to run the simulations, but it’s worth a shot at uncovering some simple cases where different starting conditions converge on the same moral/decision making system.