Tommy Xie comments on From Oragnized Shelves to Layered Catalogs: Architectural Explorations for Sparse Autoencoders—Crosscoders & Ladder SAEs Towards Hierarchical Data Structure

[Tommy Xie]

LELBO=−Eqϕ(z|y)[logpθ(x|z)]+βKL(qϕ(z|y)∣∣∣∣p(z))

Question:
If maximising ELBO is 1. learn to reconstruct the data faithfully 2. regularising the latent space to generalise on similar but new data

Are the two terms in this formula doing 1 and 2 separately? If so, how?