(I don’t think it’s good to add a canary in this case (the main concern would be takeover strategies, but I basically agree this isn’t that helpful), but I think people might be reacting to “might be worth adding” and are disagree reacting to your comment because it says “are you actually serious” which seems more dismissive than needed. IMO, we want AIs trained on this if they aren’t themselves very capable (to improve epistemics around takeover risk) and I feel close to indifferent for AIs that are plausibly very capable as the effect on takeover plans is small and you still get some small epistemic boost.)
(I don’t think it’s good to add a canary in this case (the main concern would be takeover strategies, but I basically agree this isn’t that helpful), but I think people might be reacting to “might be worth adding” and are disagree reacting to your comment because it says “are you actually serious” which seems more dismissive than needed. IMO, we want AIs trained on this if they aren’t themselves very capable (to improve epistemics around takeover risk) and I feel close to indifferent for AIs that are plausibly very capable as the effect on takeover plans is small and you still get some small epistemic boost.)
For the record, I genuinely did not know if it was meant to be serious.