What if the effect of AGI development would be our reform instead of our extinction?
There is a burden to prove not only that ‘some’ AGI development will be good for humanity (reforming, to use your words), but that all AGI cannot possibly lead to extinction. If someone creates a reforming-AI today, and then the next day, someone creates an evil AI, we will probably still all die.
@daijin, let’s suppose you were the victim of social injustice and someone else claimed that the mere risk of existential threat justifies perpetuating that injustice. Would you accept that excuse and embrace victimhood? If not, then there is no burden to prove that AI is safe—it is sufficient to prove that a human trying to behave morally without AI assistance is as hopeless as a human trying to play chess well. That proof in in the cited research.
There is a burden to prove not only that ‘some’ AGI development will be good for humanity (reforming, to use your words), but that all AGI cannot possibly lead to extinction. If someone creates a reforming-AI today, and then the next day, someone creates an evil AI, we will probably still all die.
@daijin, let’s suppose you were the victim of social injustice and someone else claimed that the mere risk of existential threat justifies perpetuating that injustice. Would you accept that excuse and embrace victimhood? If not, then there is no burden to prove that AI is safe—it is sufficient to prove that a human trying to behave morally without AI assistance is as hopeless as a human trying to play chess well. That proof in in the cited research.