R1 <-> R4 are arbitrary positive floating point numbers. Units are currency units. So “human harm” is in terms of estimated actual costs + estimate reputation damage paid for injuries/wrongful deaths, “outside boundary” is an estimate of the fines for trespassing and settlements paid in lawsuits, “paperclips made” is the economic value of the paperclips, and operating cost is obvious.
Hmm. Either I’m misunderstanding, or you just described a completely amoral optimizer, which will kill billions as long as it can’t be held financially liable. Maybe just take over the governments (or at least currency control), so it can’t be financially penalized for anything, ever.
Also, you’re adding paperclip-differential to money, so the result won’t be pure money. That’s probably good, because otherwise this beast stops making paperclips and optimizes for negative realized costs on one of the other dimensions.
R1 <-> R4 are arbitrary positive floating point numbers. Units are currency units. So “human harm” is in terms of estimated actual costs + estimate reputation damage paid for injuries/wrongful deaths, “outside boundary” is an estimate of the fines for trespassing and settlements paid in lawsuits, “paperclips made” is the economic value of the paperclips, and operating cost is obvious.
Hmm. Either I’m misunderstanding, or you just described a completely amoral optimizer, which will kill billions as long as it can’t be held financially liable. Maybe just take over the governments (or at least currency control), so it can’t be financially penalized for anything, ever.
Also, you’re adding paperclip-differential to money, so the result won’t be pure money. That’s probably good, because otherwise this beast stops making paperclips and optimizes for negative realized costs on one of the other dimensions.