Even supposing that your conjecture is true, it’s not a dichotomy, we could be jealous of AI and we could be in danger of losing our jobs to it and dying to superintelligence.
I don’t believe that there is anything really there to be jealous of though. I would say for me, jealousy requires personhood, and I don’t view current LLM agents as people, so there’s nothing to envy. Moreover, even if you take as an assumption that agents are people, they definitely don’t have meaningful personalities outside of what we instill in them, and are incapable of online learning or some other way of developing independent thought. As a result, even with soul documents and RL for personas, they remain fairly average in all the ways I would want to communicate with a person, even if they excel at many tasks.
The only thing I might be jealous of an agent about is that they can clone themselves ~infinitely and run in parallel.
As for not believing humans are the best species, well, I have no doubt more optimal lifeforms could be exist, but I don’t see a point in instantiating something like that just because humanity has a bad rap sheet. I’m still having fun living, and I think lots of people are too. Maybe after everybody gets bored of regular life we can look into setting up successors.
Lately I’ve been most concerned about coordination for governance, and having the ability to nicely merge values from lots of people to determine what policies a democratic government should take. I think current methods of voting leave a lot to be desired, and it should be possible to use AI to help people build personal models of their preferences that can be diffed/merged with other preferences, enabling easy creation of coalitions or identifying points of agreement. I think Andrey Tang’s post on Plurality is pretty useful for getting an idea of how similar things could work.
There are a lot of other dimensions for coordination though, getting accurate information from distorted sources, figuring out how to align representatives, better voting, etc. Mechanism design and social choice theory are good places to look for academic research on this stuff.