Each of these points look valid, but there’s a much simpler refutation: « Any good enough intelligence is smart enough to distribute part of its cognition to external devices. ».
Application: either my code includes wikipedia and whoever might change wikipedia just before I consult it, or it’s Kolmogorov complexity does not fully capture my capabilities. In a sense, this is showing the impact of putting too much confidence on a debatable picture of our capabilities and limitations as a single agent working from some cockpit.
Each of these points look valid, but there’s a much simpler refutation: « Any good enough intelligence is smart enough to distribute part of its cognition to external devices. ».
Application: either my code includes wikipedia and whoever might change wikipedia just before I consult it, or it’s Kolmogorov complexity does not fully capture my capabilities. In a sense, this is showing the impact of putting too much confidence on a debatable picture of our capabilities and limitations as a single agent working from some cockpit.