Do you think this analogy is useful for estimating the value of friendliness? That is, is the impact of humans on other species and our environment during this explosion of intelligence a useful frame for pondering the impact of a rapidly evolving AI on humans?
I think it has potential to be useful, but I’m not sure in which direction it should be read.
While we’ve driven some species toward extinction, others have flourished. And while I’m optimistic that as intelligence increases we’ll be better able to control our negative impacts on the environment, I’m also worried that as the scale of our impacts increases a single mistake could be fatal.
Eliezer ---
Do you think this analogy is useful for estimating the value of friendliness? That is, is the impact of humans on other species and our environment during this explosion of intelligence a useful frame for pondering the impact of a rapidly evolving AI on humans?
I think it has potential to be useful, but I’m not sure in which direction it should be read.
While we’ve driven some species toward extinction, others have flourished. And while I’m optimistic that as intelligence increases we’ll be better able to control our negative impacts on the environment, I’m also worried that as the scale of our impacts increases a single mistake could be fatal.