Shard TheoryQuintin Pope14 Jul 2022 1:36 UTCWritten by Quintin Pope, Alex Turner, Charles Foster, and Logan Smith. Card image generated by DALL-E 2:Humans provide an untapped wealth of evidence about alignmentTurnTrout and Quintin Pope14 Jul 2022 2:31 UTC214 points94 comments9 min readLW link1 reviewHuman values & biases are inaccessible to the genomeTurnTrout7 Jul 2022 17:29 UTC95 points54 comments6 min readLW link1 reviewGeneral alignment propertiesTurnTrout8 Aug 2022 23:40 UTC51 points2 comments1 min readLW linkEvolution is a bad analogy for AGI: inner alignmentQuintin Pope13 Aug 2022 22:15 UTC82 points18 comments8 min readLW linkReward is not the optimization targetTurnTrout25 Jul 2022 0:03 UTC401 points129 comments11 min readLW link3 reviewsThe shard theory of human valuesQuintin Pope and TurnTrout4 Sep 2022 4:28 UTC267 points67 comments24 min readLW link2 reviewsUnderstanding and avoiding value driftTurnTrout9 Sep 2022 4:16 UTC48 points14 comments6 min readLW linkA shot at the diamond-alignment problemTurnTrout6 Oct 2022 18:29 UTC97 points67 comments15 min readLW linkDon’t design agents which exploit adversarial inputsTurnTrout and Garrett Baker18 Nov 2022 1:48 UTC72 points64 comments12 min readLW linkDon’t align agents to evaluations of plansTurnTrout26 Nov 2022 21:16 UTC48 points49 comments18 min readLW linkAlignment allows “nonrobust” decision-influences and doesn’t require robust gradingTurnTrout29 Nov 2022 6:23 UTC62 points41 comments15 min readLW linkInner and outer alignment decompose one hard problem into two extremely hard problemsTurnTrout2 Dec 2022 2:43 UTC155 points23 comments47 min readLW link3 reviews
