This is a sequence by Scott Garrabrant and Abram Demski on one current way of thinking about alignment: Embedded Agency.