Cons: Humans are opaque. Even from our inside view, it is very difficult to understand how they work, and very hard to modify. They are also the most difficult to talk about rigorously. There is also the failure mode of anthropomorphizing badly and attributing arbitrary properties of humans (and especially human goals) to AGI.
I don’t think it’s really correct to say that humans are opaque from an inside view, especially for people with high empathy. People who understand themselves well and have high empathy can very consistently predict and understand others.
I don’t think it’s really correct to say that humans are opaque from an inside view, especially for people with high empathy. People who understand themselves well and have high empathy can very consistently predict and understand others.