It once occurred to me that modern civilization occupies an unstable state. I. J. Good’s hypothesized intelligence explosion describes a dynamically unstable system, like a pen precariously balanced on its tip. If the pen is exactly vertical, it may remain upright; but if the pen tilts even a little from the vertical, gravity pulls it farther in that direction, and the process accelerates. So too would smarter systems have an easier time making themselves smarter
The quote you found looks to me like someone paraphrased and simplified that passage.
Amazing, thank you! Given Yudkowsky’s frequent re-use of metaphors, it wouldn’t surprise me if there exists a version with the exact wording. But this suffices to demonstrate this thought of his was not prompted by the announcement of GPT-3. Thanks again!
I found it on a quote aggregator from 2015: https://www.houzz.com/discussions/2936212/quotes-3-23-15. Archive.org definitely has that quote appearing on websites in February 2016
Sounds to me like 2008-era Yudkowsky.
Edit: I found this in the 2008 Artificial Intelligence as a Positive and Negative Factor in Global Risk:
The quote you found looks to me like someone paraphrased and simplified that passage.
Amazing, thank you! Given Yudkowsky’s frequent re-use of metaphors, it wouldn’t surprise me if there exists a version with the exact wording. But this suffices to demonstrate this thought of his was not prompted by the announcement of GPT-3. Thanks again!