In the space of possible mind-designs, very few AIs care about humans as anything but raw resources.
An AGI cares about not being killed by humans.
In the space of possible mind-designs, your mind (and every human mind) is an extreme specialist in manipulating humans.
Corn manipulates humans to kill parasites that might damage the corn by a variety of ways. An entity doesn’t need to be smart to be engaged in manipulating humans.
As long as humans have the kind of power over our world that they have at the moment and AGI will either be skilled in dealing with humans or humans will shut it down if there seems to be a danger of the AGI amazing power and not caring about humans.
An AGI cares about not being killed by humans.
Corn manipulates humans to kill parasites that might damage the corn by a variety of ways. An entity doesn’t need to be smart to be engaged in manipulating humans.
As long as humans have the kind of power over our world that they have at the moment and AGI will either be skilled in dealing with humans or humans will shut it down if there seems to be a danger of the AGI amazing power and not caring about humans.