MichaelEinhorn

Mode col­lapse in RL may be fueled by the up­date equation

• MichaelEinhorn 9 Aug 2022 3:38 UTC

  3 points

  3

  on: Broad Bas­ins and Data Compression

  Would be interesting to try to distinguish between 3 types of dimensions. Number of dimensions that leave the set, number of dimensions in the set due to trivial params, and number of dimensions in the set due to equally good but functionally different models.

  Especially if it turns out it is attracted to maximum trivial params, but not maximum dimensionality overall.

Race Along Rashomon Ridge