Ice cream and condoms didn’t exist in the ancestral environment; using them as criticism of evolution is like using a screwdriver to pound nails and then blaming it for being a poorly designed hammer.
The backward retina may be an interesting case in point here: I’ve seen an article (years ago, don’t remember the link) claiming it makes maintenance easier; an important advantage if so, considering that unlike your cell phone camera, this is a piece of hardware that has to operate without replacement for a timescale on the order of a century. I don’t know whether it’s a good trade-off on balance, but even if it’s not the optimal design, it might still make the retina a relevant example of something that actually makes more sense than it would seem at first glance.
Ice cream and condoms didn’t exist in the ancestral environment; using them as criticism of evolution is like using a screwdriver to pound nails and then blaming it for being a poorly designed hammer.
No, it is precisely the point. I am cleverer than a hammer. Evolution is dumb enough to have gone ahead and created its usurper. Evolution really will go ahead and evolve itself to irrelevance. By the time it figures out that the current state of it’s cleverest creations isn’t one where they optimise their response to future selective pressures it’ll be too late. We’ll have solved the relevant cooperation problem or we’ll have messed up evolution’s existing creations and resources beyond all recognition.
The backward retina may be an interesting case in point here: I’ve seen an article (years ago, don’t remember the link) claiming it makes maintenance easier; an important advantage if so, considering that unlike your cell phone camera, this is a piece of hardware that has to operate without replacement for a timescale on the order of a century. I don’t know whether it’s a good trade-off on balance, but even if it’s not the optimal design, it might still make the retina a relevant example of something that actually makes more sense than it would seem at first glance.
I consider that an example of human cleverness. If there is one thing we are good at it is creating arguments for things that are caused by something completely irrelevant. Take that Urist McHatedRival!
/ “Evolution is dumb enough to have gone ahead and created its usurper. Evolution really will go ahead and evolve itself to irrelevance. ”
Not every possible set of genes or every possible consciousness can be expressed, but (barring annihilation) there will be some subset expressed. And there will be some historical path that got us there, and reasons why certain traits exist while others do not. So I fail to see how evolution can ever be irrelevant. Perhaps nerd/early adopter traits will be selected rather than the historical bigger/stronger/faster, but this is still evolution.
/ “By the time it figures out that the current state of it’s cleverest creations isn’t one where they optimise their response to future selective pressures it’ll be too late”
I’m not sure I understand what you are saying here. Organisms have never optimized their response to future selective pressures, they have merely executed their current adaptations. If you are saying that, as a human, I can wear a condom to enjoy sex without reproduction, I agree. But this is not overcoming evolution. This is merely how I express the traits that evolution has given me (ie sexual desire + desire not to ruin life with infant.) I think one should be careful about anthropomorphizing evolution, as it leads to murky reasoning. Evolution is not clever or stupid, it merely is.
Can you lay out explicitly what you mean by that? I’m not sure I understand.
If you are saying that the singularity will fundamentally change alter evolution, sure. Perhaps evolution will no longer proceed through proteins in a flesh covered body. But barring some stasis, there will be changes in the make up of a population. I don’t think it is that big of an assumption to say these changes will be more than random. Perhaps it is Dr. Evil who copies his consciousness n times, or people who undergo cognitive enhancement, but I don’t foresee the current mix of traits remaining constant.
If creating a better optimizer than yourself makes you dumb, what does that say about people trying to build GAI?
By analogy it would seem to imply that they are dumber than the GAI they are trying to create. I think that’s the point of creating it. Now, let’s see if we can create one that doesn’t obliterate its masters!
That’s exactly why it’s not cleverer than us—we live in an environment with ice cream and condoms. Among the !Kung, the saying might make sense (except that an explicit understanding of evolution didn’t exist in the ancestral environment, either). We’ve been handed a better screwdriver than we could make, but so what? We need a better hammer, and we can make one.
Ice cream and condoms didn’t exist in the ancestral environment; using them as criticism of evolution is like using a screwdriver to pound nails and then blaming it for being a poorly designed hammer.
The backward retina may be an interesting case in point here: I’ve seen an article (years ago, don’t remember the link) claiming it makes maintenance easier; an important advantage if so, considering that unlike your cell phone camera, this is a piece of hardware that has to operate without replacement for a timescale on the order of a century. I don’t know whether it’s a good trade-off on balance, but even if it’s not the optimal design, it might still make the retina a relevant example of something that actually makes more sense than it would seem at first glance.
No, it is precisely the point. I am cleverer than a hammer. Evolution is dumb enough to have gone ahead and created its usurper. Evolution really will go ahead and evolve itself to irrelevance. By the time it figures out that the current state of it’s cleverest creations isn’t one where they optimise their response to future selective pressures it’ll be too late. We’ll have solved the relevant cooperation problem or we’ll have messed up evolution’s existing creations and resources beyond all recognition.
I consider that an example of human cleverness. If there is one thing we are good at it is creating arguments for things that are caused by something completely irrelevant. Take that Urist McHatedRival!
Shouldn’t that have been Urist McHatedRival?
True. Fixed. :)
/ “Evolution is dumb enough to have gone ahead and created its usurper. Evolution really will go ahead and evolve itself to irrelevance. ”
Not every possible set of genes or every possible consciousness can be expressed, but (barring annihilation) there will be some subset expressed. And there will be some historical path that got us there, and reasons why certain traits exist while others do not. So I fail to see how evolution can ever be irrelevant. Perhaps nerd/early adopter traits will be selected rather than the historical bigger/stronger/faster, but this is still evolution.
/ “By the time it figures out that the current state of it’s cleverest creations isn’t one where they optimise their response to future selective pressures it’ll be too late”
I’m not sure I understand what you are saying here. Organisms have never optimized their response to future selective pressures, they have merely executed their current adaptations. If you are saying that, as a human, I can wear a condom to enjoy sex without reproduction, I agree. But this is not overcoming evolution. This is merely how I express the traits that evolution has given me (ie sexual desire + desire not to ruin life with infant.) I think one should be careful about anthropomorphizing evolution, as it leads to murky reasoning. Evolution is not clever or stupid, it merely is.
Inferential Distance Out Of Bounds Exception: Fundamental premises and expectations about probable future outcomes incompatible.
Off the top of my head the options include
Everything is dead
Things stop dying
Things solve the critical cooperation problem.
Somebody just wins.
Grey goo (doesn’t die/mutate fast enough to evolve. Consumes all resources)
Paperclipping. It’ll self replicate probably but there will be no incremental changing based on the whim of selective pressure.
AGI of any other kind (FAI or otherwise).
Any other scenario in which the earth becomes a non-viable habitat without first seeding to somewhere else.
Can you lay out explicitly what you mean by that? I’m not sure I understand.
If you are saying that the singularity will fundamentally change alter evolution, sure. Perhaps evolution will no longer proceed through proteins in a flesh covered body. But barring some stasis, there will be changes in the make up of a population. I don’t think it is that big of an assumption to say these changes will be more than random. Perhaps it is Dr. Evil who copies his consciousness n times, or people who undergo cognitive enhancement, but I don’t foresee the current mix of traits remaining constant.
If creating a better optimizer than yourself makes you dumb, what does that say about people trying to build GAI?
By analogy it would seem to imply that they are dumber than the GAI they are trying to create. I think that’s the point of creating it. Now, let’s see if we can create one that doesn’t obliterate its masters!
That’s exactly why it’s not cleverer than us—we live in an environment with ice cream and condoms. Among the !Kung, the saying might make sense (except that an explicit understanding of evolution didn’t exist in the ancestral environment, either). We’ve been handed a better screwdriver than we could make, but so what? We need a better hammer, and we can make one.