Thanks for writing this, though I admit that I remain somewhat confused about exactly how pivotal acts differ from the naive “someone takes control over the world and then, instead of using that control for personal gain or other bad things, uses it to prevent anyone from ending the world”.
I see that your “memetically fit alignment article” doesn’t fit this template—would the publicaron of that article count as a pivotal act even in the absence of some entity that can ensure that nobody intentionally destroys the world? If that does count as a pivotal act, and that was what you were pointing at, then your article really did correct a misunderstanding I had.
Yes, if you can make the article’s contents be in all the brains that would be liable to accidentally create a misaligned AGI, now and in the future, and we also assume that none of these brains want to intentionally create a misaligned AGI, then that would count as a pivotal act in my book.
This might work without the assumption that nobody wants to create a misaligned AGI, through a different mechanism than described in the OP. Then it seems relatively likely that there is enough oomph to push for effective regulations.
Thanks for writing this, though I admit that I remain somewhat confused about exactly how pivotal acts differ from the naive “someone takes control over the world and then, instead of using that control for personal gain or other bad things, uses it to prevent anyone from ending the world”.
I see that your “memetically fit alignment article” doesn’t fit this template—would the publicaron of that article count as a pivotal act even in the absence of some entity that can ensure that nobody intentionally destroys the world? If that does count as a pivotal act, and that was what you were pointing at, then your article really did correct a misunderstanding I had.
Yes, if you can make the article’s contents be in all the brains that would be liable to accidentally create a misaligned AGI, now and in the future, and we also assume that none of these brains want to intentionally create a misaligned AGI, then that would count as a pivotal act in my book.
This might work without the assumption that nobody wants to create a misaligned AGI, through a different mechanism than described in the OP. Then it seems relatively likely that there is enough oomph to push for effective regulations.