Phil, I’m not really sure what your criticism has to do with what Eliezer wrote. He’s saying that evolution is contingent—bits that work can get locked into place because other bits rely on them. Eliezer asserts that AI design is not contingent in this manner, so the space of possible AI designs does not form a natural class, unlike the space of realized Earth-based lifeforms. Your objection is… what, precisely?
Phil, I’m not really sure what your criticism has to do with what Eliezer wrote. He’s saying that evolution is contingent—bits that work can get locked into place because other bits rely on them. Eliezer asserts that AI design is not contingent in this manner, so the space of possible AI designs does not form a natural class, unlike the space of realized Earth-based lifeforms. Your objection is… what, precisely?