I help run the Pivotal fellowship. We had a discussion activity where we took various statements and agreed/disagreed (“change my view” activity). Around 2⁄3 of fellows were pessimistic about current methods being on track to align or control superintelligence.
Would this update you a bit against your original point in the post? I’m not that sure very detailed understanding of Instrumental Convergance is needed for getting a decent intuition for why ASI alignment is going to be hard
Curious to hear your takes and if you have ideas for how to elicit the fellows opinions/get them to engage with the ideas in a useful way.
To make sure I understand correctly: the fellows don’t know what instrumental convergence is but they think alignment is hard (probably implied by not feeling like we are on track to solving it)?
I havent asked them whether they know about Instrumental convergence, but i’d guess at least 50% of them dont—ppl that joined the field 1yr ago or less and mostly did SPAR/Bluedot generally wont be very MIRI pilled.
I help run the Pivotal fellowship. We had a discussion activity where we took various statements and agreed/disagreed (“change my view” activity). Around 2⁄3 of fellows were pessimistic about current methods being on track to align or control superintelligence.
Would this update you a bit against your original point in the post? I’m not that sure very detailed understanding of Instrumental Convergance is needed for getting a decent intuition for why ASI alignment is going to be hard
Curious to hear your takes and if you have ideas for how to elicit the fellows opinions/get them to engage with the ideas in a useful way.
To make sure I understand correctly: the fellows don’t know what instrumental convergence is but they think alignment is hard (probably implied by not feeling like we are on track to solving it)?
I havent asked them whether they know about Instrumental convergence, but i’d guess at least 50% of them dont—ppl that joined the field 1yr ago or less and mostly did SPAR/Bluedot generally wont be very MIRI pilled.