I think it’s pretty plausible that something pathological like that is happening. We’re releasing this as an interesting idea that others might find useful for their use case, not as something we’re confident is a superior method. If we were continuing with SAE work, we would likely sanity check it more but we thought it better to release it than not
I think it’s pretty plausible that something pathological like that is happening. We’re releasing this as an interesting idea that others might find useful for their use case, not as something we’re confident is a superior method. If we were continuing with SAE work, we would likely sanity check it more but we thought it better to release it than not