What bothers me in The Basic AI Drives is a complete lack of quantitativeness.
Temporal discount rate isn’t even mentioned. No analysis of self-improvement/getting-things-done tradeoff. Influence of explicit / implicit utility function dichotomy on self-improvement aren’t considered.
I find some of your issues with the piece legitimate but stand by my characterization of the most serious existential threat from AI being of the type described in the therein.
What bothers me in The Basic AI Drives is a complete lack of quantitativeness.
Temporal discount rate isn’t even mentioned. No analysis of self-improvement/getting-things-done tradeoff. Influence of explicit / implicit utility function dichotomy on self-improvement aren’t considered.
I find some of your issues with the piece legitimate but stand by my characterization of the most serious existential threat from AI being of the type described in the therein.