What do you think of “Locked In AI (LIAI)” for when an AI becomes sufficiently capable that it’s preferences / utility function are “locked in” and can no longer be altered or avoided by other agents? This “locking in” is how I refer to the theoretical point of an RSI when it becomes too late to stop or alter course.
Also, for what it’s worth, I like “artificial general super intelligence (AGSI) which then frees up “AGI” for AI that does general reasoning and language at any level of capability, and hilariously frees up “ASI” to refer to any AI that does what it does better than any human, so a pocket calculator is an ASI because it does arithmetic better than any human. Though more confusing, LLMs would be ASI and not AGI because they are superhuman at text prediction, but chatbots made from LLMs would be AGI and not ASI because they reason and talk with general intelligence, but it seems more limited in some ways than human reasoning.
What do you think of “Locked In AI (LIAI)” for when an AI becomes sufficiently capable that it’s preferences / utility function are “locked in” and can no longer be altered or avoided by other agents? This “locking in” is how I refer to the theoretical point of an RSI when it becomes too late to stop or alter course.
Also, for what it’s worth, I like “artificial general super intelligence (AGSI) which then frees up “AGI” for AI that does general reasoning and language at any level of capability, and hilariously frees up “ASI” to refer to any AI that does what it does better than any human, so a pocket calculator is an ASI because it does arithmetic better than any human. Though more confusing, LLMs would be ASI and not AGI because they are superhuman at text prediction, but chatbots made from LLMs would be AGI and not ASI because they reason and talk with general intelligence, but it seems more limited in some ways than human reasoning.