To me, the initial poll options make no sense without each other. For example, “avoid danger” and “communicate beliefs” don’t make sense without each other [in context of society].
If people can’t communicate (report epistemic state), “avoid danger” may not help or be based on 100% biased opinions on what’s dangerous.
If some people solve Alignment, but don’t communicate, humanity may perish due to not building a safe AGI.
If nobody solves Alignment, but nobody communicates about Alignment, humanity may perish because careless actors build an unsafe AGI without even knowing they do something dangerous.
I like communication, so I chose the second option. Even though “communicating without avoiding danger” doesn’t make sense either.
Since the poll options didn’t make much sense to me, I didn’t see myself as “facing alien values” or “fighting off babyeaters”. I didn’t press the link, because I thought it may “blow up” the site (similar to the previous Petrov’s Day) + I wasn’t sure it’s OK to click, I didn’t think my unilateralism would be analogous to Petrov’s unilateralism (did Petrov cure anyone’s values, by the way?). I decided it’s more Petrov-like to not click.
But is AGI (or anything else) related to the lessons of Petrov’s Day? That’s another can of worms. I think we should update the lessons of the past to fit the future situations. I think it doesn’t make much sense to take away from Petrov’s Day only lessons about “how to deal with launching nukes”.
Another consideration: Petrov did accurately report his epistemic state. Or would have, if it were needed (if it were needed, he would lie to accurately report his epistemic state—“there are no launches”). Or “he accurately non-reported the non-presence of nuclear missiles”.
To me, the initial poll options make no sense without each other. For example, “avoid danger” and “communicate beliefs” don’t make sense without each other [in context of society].
If people can’t communicate (report epistemic state), “avoid danger” may not help or be based on 100% biased opinions on what’s dangerous.
If some people solve Alignment, but don’t communicate, humanity may perish due to not building a safe AGI.
If nobody solves Alignment, but nobody communicates about Alignment, humanity may perish because careless actors build an unsafe AGI without even knowing they do something dangerous.
I like communication, so I chose the second option. Even though “communicating without avoiding danger” doesn’t make sense either.
Since the poll options didn’t make much sense to me, I didn’t see myself as “facing alien values” or “fighting off babyeaters”. I didn’t press the link, because I thought it may “blow up” the site (similar to the previous Petrov’s Day) + I wasn’t sure it’s OK to click, I didn’t think my unilateralism would be analogous to Petrov’s unilateralism (did Petrov cure anyone’s values, by the way?). I decided it’s more Petrov-like to not click.
But is AGI (or anything else) related to the lessons of Petrov’s Day? That’s another can of worms. I think we should update the lessons of the past to fit the future situations. I think it doesn’t make much sense to take away from Petrov’s Day only lessons about “how to deal with launching nukes”.
Another consideration: Petrov did accurately report his epistemic state. Or would have, if it were needed (if it were needed, he would lie to accurately report his epistemic state—“there are no launches”). Or “he accurately non-reported the non-presence of nuclear missiles”.