Looks like some of the protein computers ended up with your values, even. Small universe, huh?
I’ve noticed that this “protein computers” framing makes it a lot intuitively easier to think about where humans are situated in the space of intelligent algorithms.
E.g., it’s intuitively harder to think about an unaligned AGI manipulating its way past humans than it is to think about unaligned AGI optimizing the arrangement of protein computers in its vicinity. In the “humans” framing, killing all the humans is the central turning point in the takeover story. In the “protein computers” framing, it’s just the point at which it makes more sense to put in the work to scrap and replace the arrangement of protein computers with newer silicon (or whatever) computers.
I’ve noticed that this “protein computers” framing makes it a lot intuitively easier to think about where humans are situated in the space of intelligent algorithms.
E.g., it’s intuitively harder to think about an unaligned AGI manipulating its way past humans than it is to think about unaligned AGI optimizing the arrangement of protein computers in its vicinity. In the “humans” framing, killing all the humans is the central turning point in the takeover story. In the “protein computers” framing, it’s just the point at which it makes more sense to put in the work to scrap and replace the arrangement of protein computers with newer silicon (or whatever) computers.