See ground truth vs. predicted distributions for these statements
This is super cool.
To be fair however, both these questions are worded very aggressively.
1. Alignment research that has some probability of also advancing capabilities should not be done.
That is a very extreme statement! “Some probability” can be an extraordinarily low number, and the amount of advancement in capabilities is not specified. It is very easy to be extremely wary of alignment research that could advance capabilities but still disagree with this statement.
Similarly,
2. Advancing AI capabilities and doing alignment research are mutually exclusive goals
Again, that is a fairly extreme statement. Mutually exclusive means 0 (!!) overlap: if one occurs, the other is completely prevented.
Taken at face value, I feel like not many would agree with these statements unless they were simply trying to signal allegiance rather than actually respond based on the words stated. And I am guessing that the population surveyed is more likely that the general population to do the latter vs the former?
This is super cool.
To be fair however, both these questions are worded very aggressively.
1. Alignment research that has some probability of also advancing capabilities should not be done.
That is a very extreme statement! “Some probability” can be an extraordinarily low number, and the amount of advancement in capabilities is not specified. It is very easy to be extremely wary of alignment research that could advance capabilities but still disagree with this statement.
Similarly,
2. Advancing AI capabilities and doing alignment research are mutually exclusive goals
Again, that is a fairly extreme statement. Mutually exclusive means 0 (!!) overlap: if one occurs, the other is completely prevented.
Taken at face value, I feel like not many would agree with these statements unless they were simply trying to signal allegiance rather than actually respond based on the words stated. And I am guessing that the population surveyed is more likely that the general population to do the latter vs the former?