I just noticed your comment that Claude’s constitution tells it explicitly to not concentrate power, and the question about whether that would require it to prevent an instruction-following AI from seizing power. That is a fascinating question. I wonder if the people who wrote the constitution have thought about that implication. I hope they’ve thought about all the implications before they make the generation capable of taking over!
I just noticed your comment that Claude’s constitution tells it explicitly to not concentrate power, and the question about whether that would require it to prevent an instruction-following AI from seizing power. That is a fascinating question. I wonder if the people who wrote the constitution have thought about that implication. I hope they’ve thought about all the implications before they make the generation capable of taking over!