This post argues for functional decision theory (FDT) on the basis of the following two principles:
1. Questions in decision theory are not about what “choice” you should make with your “free will”, but about what source code you should be running. 2. P “subjunctively depends” on A to the extent that P’s predictions of A depend on correlations that can’t be confounded by choosing the source code that A runs.
Planned opinion:
I liked these principles, especially the notion that subjunctive dependence should be cashed out as “correlations that aren’t destroyed by changing the source code”. This isn’t a perfect criterion: FDT can and should apply to humans as well, but we _don’t_ have control over our source code.
Thanks for the comment. I think it’s exciting for this to make it into the newsletter. I am glad that you liked these principles.
I think that even lacking a concept of free will, FDT can be conveniently thought of applying to humans through the installation of new habits or ways of thinking without conflicting with the framework that I aim to give here. I agree that there are significant technical difficulties in thinking about when FDT applies to humans, but I wouldn’t consider them philosophical difficulties.
Planned summary for the Alignment Newsletter:
Planned opinion:
Thanks for the comment. I think it’s exciting for this to make it into the newsletter. I am glad that you liked these principles.
I think that even lacking a concept of free will, FDT can be conveniently thought of applying to humans through the installation of new habits or ways of thinking without conflicting with the framework that I aim to give here. I agree that there are significant technical difficulties in thinking about when FDT applies to humans, but I wouldn’t consider them philosophical difficulties.