I used Anthropic’s NLA to catch the thoughts Llama70B can’t report outside its J-space! New post here.
I split concept vectors (“secrecy”, “elephant”, “democracy”...) into J-space and non-J parts, and injected them separately using Lindsey’s “Introspection Awareness” experiment.
The model immediately reports the J-space thought, and is totally blind to the non-J space.
But even when the model denies it, an NLA catches the hidden thoughts, still steering its behavior!
Happy to chat extensions to the experiment and alignment implications :)
I used Anthropic’s NLA to catch the thoughts Llama70B can’t report outside its J-space! New post here.
I split concept vectors (“secrecy”, “elephant”, “democracy”...) into J-space and non-J parts, and injected them separately using Lindsey’s “Introspection Awareness” experiment.
The model immediately reports the J-space thought, and is totally blind to the non-J space.
But even when the model denies it, an NLA catches the hidden thoughts, still steering its behavior!
Happy to chat extensions to the experiment and alignment implications :)