A slightly different frame on this (I think less pessimistic) is something like “honesty hasn’t been invented yet”. Or, rather, explicit knowledge of how to implement honesty does not exist in a way that can be easily transferred. (Tacit knowledge of such may exist but it’s hard to validate and share)
(I’m referring, I think, to the same sort of honesty Zack is getting at here, although the aspects of it that are relevant to doublecrux that didn’t come up in that previous blogpost)
I think, obviously, that there have been massive strides (across human history, and yes on LW in particular) in how to implement “Idealized Honesty” (for lack of a better term for now). So, the problem seems pretty tractable. But it does not feel like a thing within spitting distance.
A slightly different frame on this (I think less pessimistic) is something like “honesty hasn’t been invented yet”. Or, rather, explicit knowledge of how to implement honesty does not exist in a way that can be easily transferred. (Tacit knowledge of such may exist but it’s hard to validate and share)
(I’m referring, I think, to the same sort of honesty Zack is getting at here, although the aspects of it that are relevant to doublecrux that didn’t come up in that previous blogpost)
I think, obviously, that there have been massive strides (across human history, and yes on LW in particular) in how to implement “Idealized Honesty” (for lack of a better term for now). So, the problem seems pretty tractable. But it does not feel like a thing within spitting distance.
The kind of honesty Zack is talking about is desirable, but it’s unclear whether it’s sufficient for Aumann’s theorem to apply.