The thing I’ll say on the orthogonality thesis is that I think it’s actually fairly obvious, but only because it makes extremely weak claims, in that it’s logically possible for AI to be misaligned, and the critical mistake is assuming that possibility translates into non-negligible likelihood.
It’s useful for history purposes, but is not helpful at all for alignment, as it fails to answer essential questions.
The thing I’ll say on the orthogonality thesis is that I think it’s actually fairly obvious, but only because it makes extremely weak claims, in that it’s logically possible for AI to be misaligned, and the critical mistake is assuming that possibility translates into non-negligible likelihood.
It’s useful for history purposes, but is not helpful at all for alignment, as it fails to answer essential questions.