Even if the AI somehow never gets smart enough to operate everything in the economy and get rid of the humans, this is a perfectly compelling story for why it’s critical to regulate AI now.
Some of my worst s-risk nightmares start something like—and I advise you think long and hard before clicking this spoiler tag:
“Maybe truly good robotics is very hard, but genetically modifying humans to be inherently servile to the AIs (or possibly to goal-setting brain implants) is the path of least resistance.”
That’s one of the futures that scares me more than ordinary x-risks.
I don’t think you need genetic modification, I think you can get far with dopamine-induced feedback loops that turn off critical thinking and compress literacy + basic drive incentivisation.
Some of my worst s-risk nightmares start something like—and I advise you think long and hard before clicking this spoiler tag:
That’s one of the futures that scares me more than ordinary x-risks.
I don’t think you need genetic modification, I think you can get far with dopamine-induced feedback loops that turn off critical thinking and compress literacy + basic drive incentivisation.