I’m very sympathetic to this complaint; I think that these arguments simply haven’t been made rigorously, and at this point it seems like Nate and Eliezer are not in an epistemic position where they’re capable of even trying to do so. (That is, they reject the conception of “rigorous” that you and I are using in these comments, and therefore aren’t willing to formulate their arguments in a way which moves closer to meeting it.)
I’m very sympathetic to this complaint; I think that these arguments simply haven’t been made rigorously, and at this point it seems like Nate and Eliezer are not in an epistemic position where they’re capable of even trying to do so. (That is, they reject the conception of “rigorous” that you and I are using in these comments, and therefore aren’t willing to formulate their arguments in a way which moves closer to meeting it.)
You should look at my recent post on value systematization, which is intended as a framework in which these claims can be discussed more clearly.