Perhaps this is too much commentary (on Rao’s post), but given (I believe) he’s pretty widely followed/respected in the tech commentariat, and has posted/tweeted on AI alignment before, I’ve tried to respond to his specific points in a separate LW post. Have tried to incorporate comments below, but please suggest anything I’ve missed. Also if anyone thinks this isn’t an awful idea, I’m happy to see if a pub like Noema (who have run a few relevant things e.g. Gary Marcus, Yann LeCun, etc.) would be interested in putting out an (appropriately edited) response—to try to set out the position on why alignment is an issue, in publishing venues where policymakers/opinion makers might pick it up (who might be reading Rao’s blog but are perhaps not looking at LW/AF). Apologies for any conceptual or factual errors, my first LW post :-)
Perhaps this is too much commentary (on Rao’s post), but given (I believe) he’s pretty widely followed/respected in the tech commentariat, and has posted/tweeted on AI alignment before, I’ve tried to respond to his specific points in a separate LW post. Have tried to incorporate comments below, but please suggest anything I’ve missed. Also if anyone thinks this isn’t an awful idea, I’m happy to see if a pub like Noema (who have run a few relevant things e.g. Gary Marcus, Yann LeCun, etc.) would be interested in putting out an (appropriately edited) response—to try to set out the position on why alignment is an issue, in publishing venues where policymakers/opinion makers might pick it up (who might be reading Rao’s blog but are perhaps not looking at LW/AF). Apologies for any conceptual or factual errors, my first LW post :-)