I’m working on locating the persona subspace, and understanding its contents better. The gradient routing application of this I leave to anyone sufficiently skilled at gradient routing, LoRA-like structures, and RL reasoning training. The sources I cite probably give enough data on subspaces to get started. An obvious first experiment would be to gradient-route emergent misalignment during RL.
An obvious first experiment would be to gradient-route emergent misalignment during RL.
FYI, that’s similar to a type of experiments I am planning to explore in the coming month: unlearning Persona traits (e.g., gradient-routing harmful traits).
Please work on this! Very interested in results from this technique and others like it.
I’m working on locating the persona subspace, and understanding its contents better. The gradient routing application of this I leave to anyone sufficiently skilled at gradient routing, LoRA-like structures, and RL reasoning training. The sources I cite probably give enough data on subspaces to get started. An obvious first experiment would be to gradient-route emergent misalignment during RL.
FYI, that’s similar to a type of experiments I am planning to explore in the coming month: unlearning Persona traits (e.g., gradient-routing harmful traits).