Thank you, this is incredibly interesting! Did you ever write up more on the subject? I’m excited to see how it relates to mesa-optimisation in particular.
In the finite case, where I={1,…,n}, then Ui(x1,…,xn):Xi→X,α↦(x1,…,xi−1,α,xi,…,xn)
Typo: I think you mean α↦(x1,…,xi−1,α,xi+1,…,xn)?
Thank you, this is incredibly interesting! Did you ever write up more on the subject? I’m excited to see how it relates to mesa-optimisation in particular.
Typo: I think you mean α↦(x1,…,xi−1,α,xi+1,…,xn)?