I would say that, to the extent to true information allowed those outcomes to occur, and to the extent that those outcomes were harmful, the true information posed an information hazard. I.e., there was a risk of harm from true information, and the harm was that harmful wireheading or Goodharting happened.
I.e., I’d say that the wireheading or Goodharting isn’t itself an information hazard; it’s the harm that the information led to.
In the same way, it’s not that a pandemic is an information hazard, but that a pandemic is a harm that spreading certain information could lead to, which makes that information hazardous.
Does that make sense?
ETA: I guess an implicit assumption I’m making is that the access to the true information made the harmful wireheading or Goodharting more likely, in these hypotheticals. If it happens to be that any random data, or a decent subset of all possible false data, would’ve also led to the harmful outcomes with similar likelihood, then there isn’t necessarily a risk arising from true information.
Interesting.
I would say that, to the extent to true information allowed those outcomes to occur, and to the extent that those outcomes were harmful, the true information posed an information hazard. I.e., there was a risk of harm from true information, and the harm was that harmful wireheading or Goodharting happened.
I.e., I’d say that the wireheading or Goodharting isn’t itself an information hazard; it’s the harm that the information led to.
In the same way, it’s not that a pandemic is an information hazard, but that a pandemic is a harm that spreading certain information could lead to, which makes that information hazardous.
Does that make sense?
ETA: I guess an implicit assumption I’m making is that the access to the true information made the harmful wireheading or Goodharting more likely, in these hypotheticals. If it happens to be that any random data, or a decent subset of all possible false data, would’ve also led to the harmful outcomes with similar likelihood, then there isn’t necessarily a risk arising from true information.