Upvoted for the description of combining many small optimizers as the best way to make a big optimizer to do something complicated. There were earlier posts about this but they were more technical.
Upvoted for the description of combining many small optimizers as the best way to make a big optimizer to do something complicated. There were earlier posts about this but they were more technical.