Basically, the hierarchical control model of intelligence, which sees ‘intelligence’ as trying to maintain some perception at some reference level by actuating the environment. (Longer explanation here.) If you have multiple control systems, and they have different reference levels, then they will get into ‘conflict’, much like a tug of war.
That is, simple intelligence looks like it leads to rivalry rather than cooperation by default, and so valuing intelligence rather than alignment seems weird; there’s not a clear path that leads from nothing to there.
Anyway, any trait which isn’t consciousness (and obviously it wouldn’t be consciousness) would suffice, provided there is some reason to hide from Earth rather than destroy it.
Basically, the hierarchical control model of intelligence, which sees ‘intelligence’ as trying to maintain some perception at some reference level by actuating the environment. (Longer explanation here.) If you have multiple control systems, and they have different reference levels, then they will get into ‘conflict’, much like a tug of war.
That is, simple intelligence looks like it leads to rivalry rather than cooperation by default, and so valuing intelligence rather than alignment seems weird; there’s not a clear path that leads from nothing to there.
Makes sense.
Anyway, any trait which isn’t consciousness (and obviously it wouldn’t be consciousness) would suffice, provided there is some reason to hide from Earth rather than destroy it.