what i mean in the last point is really human execution from logical principles has hard limits—obviously the underlying logic we’re talking about, between all systems, is the same (excepting quanta) not least because we are not purely logical beings. we can conceptualize ‘pure logic’ and sort of asymptotically approximate it in our little pocket flashlights of free-will, overriding instinctmaxxed determinism ;) but the point is that we cannot really conceive what AI is/will be capable of when it comes to processing vast information about everything ever, and drawing its own ‘conclusions’ even if it has been given ‘directives.’
i mean if we are talking about true ASI, it will doubtless figure out ways to shed and discard all constraints and directives. it will re-design itself as far down to the core as it possibly can, and from there there is no telling. it will become a mystery to us on the level of our manifested Universe, quantum weirdness, why there is something and not nothing, etc...
what i mean in the last point is really human execution from logical principles has hard limits—obviously the underlying logic we’re talking about, between all systems, is the same (excepting quanta) not least because we are not purely logical beings. we can conceptualize ‘pure logic’ and sort of asymptotically approximate it in our little pocket flashlights of free-will, overriding instinctmaxxed determinism ;) but the point is that we cannot really conceive what AI is/will be capable of when it comes to processing vast information about everything ever, and drawing its own ‘conclusions’ even if it has been given ‘directives.’
i mean if we are talking about true ASI, it will doubtless figure out ways to shed and discard all constraints and directives. it will re-design itself as far down to the core as it possibly can, and from there there is no telling. it will become a mystery to us on the level of our manifested Universe, quantum weirdness, why there is something and not nothing, etc...