No its not. There is no objective sense in which human suffering and extinction is bad. It’s not even a matter of degree. Questions of morality are only meaningful from a subjective POV. That’s Hume’s Law in a nutshell. You can’t solve the alignment problem by believing that we should aim as close as possible to the objective truth that everything is just particles and forces and alignment doesn’t matter. It’s circular reasoning.
No its not. There is no objective sense in which human suffering and extinction is bad. It’s not even a matter of degree. Questions of morality are only meaningful from a subjective POV. That’s Hume’s Law in a nutshell. You can’t solve the alignment problem by believing that we should aim as close as possible to the objective truth that everything is just particles and forces and alignment doesn’t matter. It’s circular reasoning.