This is really cool work! I particularly like the taxonomy of self-awareness. Have you seen whether steering awareness extends to introspection about unsteered activations?
Yotam
Karma: 43
This is really cool work! I particularly like the taxonomy of self-awareness. Have you seen whether steering awareness extends to introspection about unsteered activations?
I’m sorry I missed your comment when you first posted it. What an intriguing idea! I wonder how you would identify the introspecting part of the model, or how you would differentially train it.