In a very brief form, maybe the most common cause of EA problem and stupidities are attempts to replace illegible S1 boxes able to represent human values such as ‘caring’ by legible, symbolically described, verbal moral reasoning subject to memetic pressure.
C. Thi Nguyen has written about this (in general, not specifically EA) under the labels of value capture/collapse/swamping.
C. Thi Nguyen has written about this (in general, not specifically EA) under the labels of value capture/collapse/swamping.
https://philpapers.org/rec/NGUVCH
https://www.youtube.com/watch?v=zt03qjTyefU