RationalSieve

• RationalSieve 3 Feb 2023 17:55 UTC

  1 point

  0

  in reply to: interstice’s comment on: What qual­ities does an AGI need to have to re­al­ize the risk of false vac­uum, with­out hard­cod­ing physics the­o­ries into it?

  While I think the scenario I described is very unlikely, it nonetheless remains a possibility.

  More specifically—that there might be a simpler theory of physics that explains all “naturally” occurring conditions (in a contemporary particle accelerator, in a black hole, quasar, supernova, etc.), but doesn’t predict the possibility of false vacuum in some unnatural conditions that may be created by AGI, while a more complicated theory of physics does.

  If AGI prefers a simpler theory, that may cause it to create a false vacuum decay.

• RationalSieve 3 Feb 2023 17:50 UTC

  1 point

  0

  in reply to: Dagon’s comment on: What qual­ities does an AGI need to have to re­al­ize the risk of false vac­uum, with­out hard­cod­ing physics the­o­ries into it?

  This is a hypothetical question, regarding possible (albeit not the most likely) existential risks. Maybe a non-artificial intelligence can realize it, but I’m talking about artificial because it can be programmed in different ways.

  By hardcoded, I mean forced to prefer—in this case, a more complicated physics theory with false vacuum decay over a simple one without it.

[Question] What qual­ities does an AGI need to have to re­al­ize the risk of false vac­uum, with­out hard­cod­ing physics the­o­ries into it?

• RationalSieve 27 Dec 2022 12:43 UTC

  1 point

  0

  in reply to: the gears to ascension’s comment on: Or­a­cle AGI—How can it es­cape, other than se­cu­rity is­sues? (Steganog­ra­phy?)

  Hmm, I was somewhat worried about that, but there are way more dangerous things for AI to see written on the internet.

  If you’re trying to create AGI by training it on a large internet crawl dataset, you have bigger problems...

  To fix something, we need to know what to fix first.

[Question] Or­a­cle AGI—How can it es­cape, other than se­cu­rity is­sues? (Steganog­ra­phy?)