It also slightly brought into focus for me the distinction between “theoretical decision processes I can fantasize about implementing” and “decision processes I can implement in practice by making minor tweaks to my brain’s software”. The first set can include self-less models such as paperclip maximization or optimizing those branches where I win the lottery and ignoring the rest. It’s possible that in the second set a notion of self just keeps bubbling up whatever you do.
One and a half insights is pretty good going, especially on a tough topic like this one. Because of inferential distance, what feels like 10 insights to you will feel like 1 insight to me—it’s like you’re supplying some of the missing pieces to your own jigsaw puzzle, but in my puzzle the pieces are a different shape.
I felt like I gained one insight, which I attempted to summarize in my own words in this comment.
It also slightly brought into focus for me the distinction between “theoretical decision processes I can fantasize about implementing” and “decision processes I can implement in practice by making minor tweaks to my brain’s software”. The first set can include self-less models such as paperclip maximization or optimizing those branches where I win the lottery and ignoring the rest. It’s possible that in the second set a notion of self just keeps bubbling up whatever you do.
One and a half insights is pretty good going, especially on a tough topic like this one. Because of inferential distance, what feels like 10 insights to you will feel like 1 insight to me—it’s like you’re supplying some of the missing pieces to your own jigsaw puzzle, but in my puzzle the pieces are a different shape.
So yeah, keep hacking away at the edges!