Stuart_Armstrong comments on In partially observable environments, stochastic policies can be optimal

[Stuart_Armstrong]

Yes, you can see this POMDP as a variant of the absent minded-driver, and get that result.