On language modeling and future abstract reasoning research

Link post

Hi everyone! Here I link to a sketch of my thoughts on how recent advances in language modeling may be connected, or lead, to future advances in developing machine learning models with abstract reasoning capabilities.

This was done as a side project last year during my research fellowship at the Center of Long-Term Risk. Many thanks to Daniel Kokotajlo, Jesse Clifton, Anthony DiGiovanni for useful comments.