He explained it in the Tyler Cohen interview. After taking over the world, Sam would do exactly as promised: continue going double-or-nothing until it came up nothing.
Maximizing just for expected total pleasure, as a risk neutral classical utilitarian? Maybe being okay with killing everyone or letting everyone die (from AGI, say), as long as the expected payoff in total pleasure is high enough?
I don’t really see a very plausible path for SBF to have ended up with enough power to do this, though. Money only buys you so much, against the US government and military, unless you can take them over. And I doubt SBF would destroy us with AGI if others weren’t already going to.
How?
I have an answer but I think it would be better to see how others answer this, at least first?
He explained it in the Tyler Cohen interview. After taking over the world, Sam would do exactly as promised: continue going double-or-nothing until it came up nothing.
Maximizing just for expected total pleasure, as a risk neutral classical utilitarian? Maybe being okay with killing everyone or letting everyone die (from AGI, say), as long as the expected payoff in total pleasure is high enough?
I don’t really see a very plausible path for SBF to have ended up with enough power to do this, though. Money only buys you so much, against the US government and military, unless you can take them over. And I doubt SBF would destroy us with AGI if others weren’t already going to.