It’s interesting: FHI appears to have started with academic respect and moved towards existential risk problems, whereas SIAI seems to have started with existential risk problems and is moving towards academic respect. Time will tell which method is more effective overall—but one idea that occurs out of this analysis is when SIAI spin off the rationality training, perhaps they should also spin off the existential risk work to the FHI.
Fanciful, but I could see a Singularity Institute Rationality College feeding bright researchers into a SI+FHI collaboration on the field of existential risk and similar, and feeding bright mathematics types into the SIAI’s work on friendly AI theory. The work on FAI gets done, more of the students of the rationality dojo have success (improving the status of the rationality dojo), and more papers and citations come SI’s way (improving the academic status of the Institute). This also allows the Singularity Institute’s AI-focused researchers to contribute to existential risk papers and get their names in journals without taking large amounts of their time.
It’s interesting: FHI appears to have started with academic respect and moved towards existential risk problems, whereas SIAI seems to have started with existential risk problems and is moving towards academic respect. Time will tell which method is more effective overall—but one idea that occurs out of this analysis is when SIAI spin off the rationality training, perhaps they should also spin off the existential risk work to the FHI.
Fanciful, but I could see a Singularity Institute Rationality College feeding bright researchers into a SI+FHI collaboration on the field of existential risk and similar, and feeding bright mathematics types into the SIAI’s work on friendly AI theory. The work on FAI gets done, more of the students of the rationality dojo have success (improving the status of the rationality dojo), and more papers and citations come SI’s way (improving the academic status of the Institute). This also allows the Singularity Institute’s AI-focused researchers to contribute to existential risk papers and get their names in journals without taking large amounts of their time.