Creating a self-replicating nanobot species that reliably detects and eats only dangerous agi would be an INCREDIBLE feat. Much more likely that there’s a mutation somewhere and the error correction mechanisms fail and it starts eating other stuff too.
Also it would plausibly break a whole bunch of treaties and thereby potentially start wars.
Also creating nanobot species that can compete with existing life for fuel is really really hard actually. Much harder than AGI. Probably takes at least 6 months after AGI to do something like that! (I say, 6 months after LLM AGI,)
Creating a self-replicating nanobot species that reliably detects and eats only dangerous agi would be an INCREDIBLE feat. Much more likely that there’s a mutation somewhere and the error correction mechanisms fail and it starts eating other stuff too.
Also it would plausibly break a whole bunch of treaties and thereby potentially start wars.
Also creating nanobot species that can compete with existing life for fuel is really really hard actually. Much harder than AGI. Probably takes at least 6 months after AGI to do something like that! (I say, 6 months after LLM AGI,)