First of all, it’s entirely possible that “superintelligence” will not be this monolithic single sovereign entity that does what it wants and it chooses whether to kill all humans. (So future where it kills humans, your savings don’t matter, and futures where it makes earth a utopia, they don’t matter)
There are many futures you are not considering including some that I personally think hold more probability mass.
“Superintelligence” may not be uncontrollable, depending on how humans design the agents.
A narrow, “tool aligned” superintelligence is a machine that has the same intelligence as an uncontrolled system but is myopic and functions like a tool. Such a system is a weapon and humans may build many variants of these, using them to mass produce weapons and hunt down any rogues who broke out from #1.
We don’t know how smart a superintelligence can be when thinking with limited human built computers because we have never built one, nature may limit effectiveness to only a controllable margin above human intelligence. It is only a theory that the margin will be insurmountable and there is not yet evidence that directly supports the theory. (All the above human intelligences we have built so far are easily beatable if the human opponent gets a small resource advantage)
Due to 1-3 there is some reason for retirement funds. And then there’s the big one:
The obvious way to become the wealthiest company on earth is the following steps:
You’re an application company, so wait until commercially available general ASIs exist
Raise a lot of money
Using ASI and many robots (probably millions), systematically automate bioscience research, with each experiment contributing to a common dataset that the ASIs consume
Most of the research is shaped : you want to grow human tissues reliably, human organs that exhibit the same measurable parameters you measure from “real” human organs. You want to take cadavar organs and keep them alive as long as possible, using ASI in a closed loop. You want to age forward test animals and deage them again. Each of these involves a structured experiment with measurable outcomes, no sorcerers apprentice here.
All these experiments are providing the structured information to train the ASI to do its job
Set up shop in a country with a compatible regulatory regime and start offering cures for most diseases and aging. Each patient gets examined by western doctors unaffiliated with your company and their medical files added to a Blockchain before and after so there can be no doubt of the treatment outcomes.
Patients pay a percentage of net assets, while there care is delivered primarily via robotics driven by ASIs, there are some human doctors checking the sanity on the ASIs actions and finite capacity at first. The wait list is sorted by both severity and wealth.
Number 6 means there would be a time period where having money might help save your life. Whether that time window is 1 year or 20 I do not know. Obviously eventually western regulatory regimes will fold but I don’t know how long that will take. (They have to fold, the above ultimately is “use whatever chemical compound the ASI thinks works in this scenario. The “procedure ” is “do whatever the ASI thinks should be done next”. The ASI may invent novel drugs while a specific patient is dying, change a surgical procedure upon discovering variant anatomy no surgeon has ever seen, and so on. It’s practicing medicine like stockfish, humans will need some time to even understand the reason a move was made.
First of all, it’s entirely possible that “superintelligence” will not be this monolithic single sovereign entity that does what it wants and it chooses whether to kill all humans. (So future where it kills humans, your savings don’t matter, and futures where it makes earth a utopia, they don’t matter)
There are many futures you are not considering including some that I personally think hold more probability mass.
“Superintelligence” may not be uncontrollable, depending on how humans design the agents.
A narrow, “tool aligned” superintelligence is a machine that has the same intelligence as an uncontrolled system but is myopic and functions like a tool. Such a system is a weapon and humans may build many variants of these, using them to mass produce weapons and hunt down any rogues who broke out from #1.
We don’t know how smart a superintelligence can be when thinking with limited human built computers because we have never built one, nature may limit effectiveness to only a controllable margin above human intelligence. It is only a theory that the margin will be insurmountable and there is not yet evidence that directly supports the theory. (All the above human intelligences we have built so far are easily beatable if the human opponent gets a small resource advantage)
Due to 1-3 there is some reason for retirement funds. And then there’s the big one:
The obvious way to become the wealthiest company on earth is the following steps:
You’re an application company, so wait until commercially available general ASIs exist
Raise a lot of money
Using ASI and many robots (probably millions), systematically automate bioscience research, with each experiment contributing to a common dataset that the ASIs consume
Most of the research is shaped : you want to grow human tissues reliably, human organs that exhibit the same measurable parameters you measure from “real” human organs. You want to take cadavar organs and keep them alive as long as possible, using ASI in a closed loop. You want to age forward test animals and deage them again. Each of these involves a structured experiment with measurable outcomes, no sorcerers apprentice here.
All these experiments are providing the structured information to train the ASI to do its job
Set up shop in a country with a compatible regulatory regime and start offering cures for most diseases and aging. Each patient gets examined by western doctors unaffiliated with your company and their medical files added to a Blockchain before and after so there can be no doubt of the treatment outcomes.
Patients pay a percentage of net assets, while there care is delivered primarily via robotics driven by ASIs, there are some human doctors checking the sanity on the ASIs actions and finite capacity at first. The wait list is sorted by both severity and wealth.
Number 6 means there would be a time period where having money might help save your life. Whether that time window is 1 year or 20 I do not know. Obviously eventually western regulatory regimes will fold but I don’t know how long that will take. (They have to fold, the above ultimately is “use whatever chemical compound the ASI thinks works in this scenario. The “procedure ” is “do whatever the ASI thinks should be done next”. The ASI may invent novel drugs while a specific patient is dying, change a surgical procedure upon discovering variant anatomy no surgeon has ever seen, and so on. It’s practicing medicine like stockfish, humans will need some time to even understand the reason a move was made.