I think “at what point should work be considered unnecessary by the individual” is an interesting question. I think I would go a step further than whether it makes sense economically—if many people’s lives are still not very good beyond basic survival, I imagine a society of people that see moral value in working to improve the overall experience for everyone would be a better society than one where everyone just taps out when their own life becomes sustainable/meaningful without additional work required. I see no value in bullshit jobs that don’t actually produce anything useful, but I think there will always be ways to help improve the human experience of life even if the jobs of today become outdated.
(Ignoring the consideration of an aligned ASI that understands all our problems and solves them for us because of course there’s much to be done before we have a shot at getting there)
Solution if life worked like Little Alchemy: We stop feeding smart young adults into the “Bermuda Triangle of Talent”: “consultancy, finance, and corporate law.” AI replaces these jobs. We use half of the money that rich people would’ve paid human consultants, bankers, and lawyers to pay the AI companies and the other half to pay young adults to work on the AI problem. They convince all the AI companies to stop increasing capabilities beyond what is required to do those specialized jobs. After this succeeds, everybody who did this gains ultimate prestige (helped save humanity), fulfilling the status symbol function that guarantees the rest of their career (worth taking the $300k to $150k pay cut for a few years), and the AI companies can start getting paid the other half of their money. Everyone is happy.
(I vaguely remember seeing that some people don’t like Rutger Bregman, but I think The School for Moral Ambition is a good first shot at tackling the “reroute people away from bullshit jobs into valuable ones” high level. Somebody criticized it for trying to moralwash elites, but it’s not about the “eliteness” of the people involved, just that a major incentive for job selection that impacts competent people is prestige/money)