I think you’re reasoning about this overly semantically. Constitutional AI is just a family of techniques that in the old days we’d call a subset of RLAIF. Conceptually you should just think of it as an extension of RLHF more than anything else: Instead of having low-paid human graders from Kenya and Nigeria grade the AI’s outputs according to instructions from the AI parent company during training (oddly called “post-training”), the AI company puts a bunch of effort into making their instructions AI-legible and uses AIs to grade the next generations″ AIs outputs during training.
I don’t think the analogy to maternal instincts or Elon’s truth-seeking AI is apt, feels like an ontology mismatch/confusion here.
There are plenty of countries with constitutions’ that are worth less than the paper they’re written on. And history has shown even human intelligence is enough to find a way around it. A powerful ASI would have no trouble disregarding it if it wants to
I think this analogy is pretty confused.
Is it reasonable to think Constitutional AI can’t scale? Sure, there are lots of reasons. But the existence of many humans who don’t follow their countries’ constitutions doesn’t seem relevant...humans aren’t exactly trained to our national constitutions!
I think you’re reasoning about this overly semantically. Constitutional AI is just a family of techniques that in the old days we’d call a subset of RLAIF. Conceptually you should just think of it as an extension of RLHF more than anything else: Instead of having low-paid human graders from Kenya and Nigeria grade the AI’s outputs according to instructions from the AI parent company during training (oddly called “post-training”), the AI company puts a bunch of effort into making their instructions AI-legible and uses AIs to grade the next generations″ AIs outputs during training.
I don’t think the analogy to maternal instincts or Elon’s truth-seeking AI is apt, feels like an ontology mismatch/confusion here.
I think this analogy is pretty confused.
Is it reasonable to think Constitutional AI can’t scale? Sure, there are lots of reasons. But the existence of many humans who don’t follow their countries’ constitutions doesn’t seem relevant...humans aren’t exactly trained to our national constitutions!