Right now, and for the foreseeable future, SIAI doesn’t have the funds to actually create FAI. All they’re doing is creating a theory for friendliness, which can be used when someone else has the technology to create AI. And of course, nobody else is going to use the code if it focuses on SIAI.
SIAI doesn’t have the funds to actually create FAI
Funds are not a relevant issue for this particular achievement at present time. It’s not yet possible to create a FAI even given all the money in the world; a pharaoh can’t build a modern computer. (Funds can help with moving the time when (and if) that becomes possible closer, improving the chances that it happens this side of an existential catastrophe.)
Yeah, I was assuming that they were able to create FAI for the sake of responding to the grandparent post. If they weren’t, then there wouldn’t be any trouble with SIAI making AI only friendly to themselves to begin with.
The theory for friendliness is completely separate from the theory of AI. So, assuming they complete one does not mean that they complete the other. Furthermore, for something as big as AI/FAI, the computing power required is likely to be huge, which makes it unlikely that a small company like SIAI will be able to create it.
Though, I suppose it might be possible if they were able to get large enough loans, I don’t have the technical knowledge to say how much computing power is needed or how much that would cost.
The theory for friendliness is completely separate from the theory of AI.
??? Maybe I’m being stupid, but I suspect it’s fairly hard to fully and utterly solve the friendliness problem without, by the end of doing so, AT LEAST solving many of the tricky AI problems in general.
Right now, and for the foreseeable future, SIAI doesn’t have the funds to actually create FAI. All they’re doing is creating a theory for friendliness, which can be used when someone else has the technology to create AI. And of course, nobody else is going to use the code if it focuses on SIAI.
Funds are not a relevant issue for this particular achievement at present time. It’s not yet possible to create a FAI even given all the money in the world; a pharaoh can’t build a modern computer. (Funds can help with moving the time when (and if) that becomes possible closer, improving the chances that it happens this side of an existential catastrophe.)
Yeah, I was assuming that they were able to create FAI for the sake of responding to the grandparent post. If they weren’t, then there wouldn’t be any trouble with SIAI making AI only friendly to themselves to begin with.
If they have all the threory and coded it and whatnot, where is the cost coming from?
The theory for friendliness is completely separate from the theory of AI. So, assuming they complete one does not mean that they complete the other. Furthermore, for something as big as AI/FAI, the computing power required is likely to be huge, which makes it unlikely that a small company like SIAI will be able to create it.
Though, I suppose it might be possible if they were able to get large enough loans, I don’t have the technical knowledge to say how much computing power is needed or how much that would cost.
??? Maybe I’m being stupid, but I suspect it’s fairly hard to fully and utterly solve the friendliness problem without, by the end of doing so, AT LEAST solving many of the tricky AI problems in general.