Fabien Roger comments on How “Discovering Latent Knowledge in Language Models Without Supervision” Fits Into a Broader Alignment Scheme

[Fabien Roger]

Clarification: the reason why this bypasses the concern is that you can compute the max with training instead of enumeration.