What’s the current best known solution to the 5 and 10 problem? I feel like actual agents have heuristic self-models rather than this cursed logical counterfactual thing and so there’s no guarantee a solution exists. But I don’t even know what formal properties we want, so I also don’t know whether we have impossibility theorems, some properties have gone out of fashion, or people think it can still work.
I don’t know, I stopped working on decision theory with any significant % of my energy around the time I made this meme, and so if anything my understanding of the field has gradually decayed since then rather than grown.
What sort of context would you use this meme in? This feels like a response to the “bad things are actually better than good things” position that people sometimes take, but I don’t know who would say $5 is better than $10
Reposting this meme here so I can find it more easily later:
What’s the current best known solution to the 5 and 10 problem? I feel like actual agents have heuristic self-models rather than this cursed logical counterfactual thing and so there’s no guarantee a solution exists. But I don’t even know what formal properties we want, so I also don’t know whether we have impossibility theorems, some properties have gone out of fashion, or people think it can still work.
I don’t know, I stopped working on decision theory with any significant % of my energy around the time I made this meme, and so if anything my understanding of the field has gradually decayed since then rather than grown.
What sort of context would you use this meme in? This feels like a response to the “bad things are actually better than good things” position that people sometimes take, but I don’t know who would say $5 is better than $10
https://www.lesswrong.com/posts/i3BTagvt3HbPMx6PN/embedded-agency-full-text-version#2_1__Action_counterfactuals, https://agentfoundations.org/item?id=1399, https://www.alignmentforum.org/posts/5bd75cc58225bf06703753d4/two-major-obstacles-for-logical-inductor-decision-theory?commentId=fJGDzhKy2FQQpPqKn
Ah, I see the problem. Daniel must have a very a sophisticated decision theory indeed to know that $10 is better than $5!
You forgot Vibe Decision Theory!