RSS

Superintelligence

TagLast edit: 26 Sep 2020 4:11 UTC by Swimmer963

A Superintelligence is a being with superhuman intelligence, and a focus of the Machine Intelligence Research Institute’s research. Specifically, Nick Bostrom (1997) defined it as

“An intellect that is much smarter than the best human brains in practically every field, including scientific creativity, general wisdom and social skills.”

The Machine Intelligence Research Institute is dedicated to ensuring humanity’s safety and prosperity by preparing for the development of an Artificial General Intelligence with superintelligence. Given its intelligence, it is likely to be incapable of being controlled by humanity. It is important to prepare early for the development of friendly artificial intelligence, as there may be an AI arms race. A strong superintelligence is a term describing a superintelligence which is not designed with the same architecture as the human brain.

An Artificial General Intelligence will have a number of advantages aiding it in becoming a superintelligence. It can improve the hardware it runs on and obtain better hardware. It will be capable of directly editing its own code. Depending on how easy its code is to modify, it might carry out software improvements that spark further improvements. Where a task can be accomplished in a repetitive way, a module preforming the task far more efficiently might be developed. Its motivations and preferences can be edited to be more consistent with each other. It will have an indefinite life span, be capable of reproducing, and transfer knowledge, skills, and code among its copies as well as cooperating and communicating with them better than humans do with each other.

The development of superintelligence from humans is another possibility, sometimes termed a weak superintelligence. It may come in the form of whole brain emulation, where a human brain is scanned and simulated on a computer. Many of the advantages a AGI has in developing superintelligence apply here as well. The development of Brain-computer interfaces may also lead to the creation of superintelligence. Biological enhancements such as genetic engineering and the use of nootropics could lead to superintelligence as well.

Blog Posts

External Links

See Also

Su­per­in­tel­li­gence FAQ

Scott Alexander20 Sep 2016 19:00 UTC
45 points
7 comments27 min readLW link

Su­per­in­tel­li­gence Read­ing Group—Sec­tion 1: Past Devel­op­ments and Pre­sent Capabilities

KatjaGrace16 Sep 2014 1:00 UTC
41 points
233 comments7 min readLW link

Su­per­in­tel­li­gence read­ing group

KatjaGrace31 Aug 2014 14:59 UTC
30 points
2 comments2 min readLW link

Su­per­in­tel­li­gent AGI in a box—a ques­tion.

Dmytry23 Feb 2012 18:48 UTC
16 points
77 comments2 min readLW link

Su­per­in­tel­li­gence 7: De­ci­sive strate­gic advantage

KatjaGrace28 Oct 2014 1:01 UTC
18 points
60 comments6 min readLW link

Su­per­in­tel­li­gence via whole brain emulation

AlexMennen17 Aug 2016 4:11 UTC
14 points
33 comments3 min readLW link

Su­per­in­tel­li­gence 5: Forms of Superintelligence

KatjaGrace14 Oct 2014 1:00 UTC
22 points
114 comments5 min readLW link

Con­tain­ing the AI… In­side a Si­mu­lated Reality

HumaneAutomation31 Oct 2020 16:16 UTC
1 point
5 comments2 min readLW link

Are we all mis­al­igned?

Mateusz Mazurkiewicz3 Jan 2021 2:42 UTC
10 points
0 comments5 min readLW link

Suffer­ing-Fo­cused Ethics in the In­finite Uni­verse. How can we re­deem our­selves if Mul­ti­verse Im­mor­tal­ity is real and sub­jec­tive death is im­pos­si­ble.

Szymon Kucharski24 Feb 2021 21:02 UTC
−6 points
4 comments70 min readLW link
No comments.