From this we can conclude that a superintelligent minds are permitted by physics, but not necessarily that one can jump from intelligence to superintelligence through an intelligence explosion.
I still don’t perceive it to be anywhere close to being “obvious” that an intelligence explosion, as opposed to learning and intelligence amplification, is more than a possibility (in the sense that is far from being certain).
intelligence explosion, as opposed to learning and intelligence amplification
It seems like a false dichotomy to me. “Explosion” in this context surely just refers to rapid exponential growth—as seen in an a nuclear explosion. We are seeing that already in functional intelligence, and it is happening through education and augmentation.
Right! I started assuming Intelligence Explosion followed from physicalism, since Luke is a cool guy, and he said so. I think I changed my mind somewhere in the middle of writing the post above. Maybe stop at “Oh! Superintelligence!” instead of also “Oh! Intelligence explosion!”, but Michael Vassar is smarter than me, so I’m probably missing something.
Oh. Crap. I think I reversed my position again.
Why? Well, a sufficiently powerful mind that is given enough time should explode or extinguish.
I still don’t perceive it to be anywhere close to being “obvious” that an intelligence explosion, as opposed to learning and intelligence amplification, is more than a possibility (in the sense that is far from being certain).
It seems like a false dichotomy to me. “Explosion” in this context surely just refers to rapid exponential growth—as seen in an a nuclear explosion. We are seeing that already in functional intelligence, and it is happening through education and augmentation.
Right! I started assuming Intelligence Explosion followed from physicalism, since Luke is a cool guy, and he said so. I think I changed my mind somewhere in the middle of writing the post above. Maybe stop at “Oh! Superintelligence!” instead of also “Oh! Intelligence explosion!”, but Michael Vassar is smarter than me, so I’m probably missing something.
Oh. Crap. I think I reversed my position again.
Why? Well, a sufficiently powerful mind that is given enough time should explode or extinguish.