I note that AI economies like this will often have explosively better credit assignment for information production than human economies can. Artificial agents can be copied or rolled back (erase memories), which makes it possible to reverse the receipt of information if an assessor concludes with a price that the seller considers too low for a deal. In human economies, that’s impossible, you can’t send a clone to value a piece of information then delete them if you decide not to buy that information (that’s too expensive/illegal) nor can you wipe their memory of the information (or, we don’t know how to do that), so the very basic requirement for trade, assessment prior to purchase, is not possible in human economies, so information doesn’t get priced accurately and it has to be treated as a public good.
When implementing this (internal privacy) in a multi-agent architecture, though, make sure to take measures to prevent the formation of monopolies, I feel like information is kind of an increasing returns type of good, yeah? The more you have the more you can do with it. It could quickly stop being multi-agent, and at worst, the monopoly could consolidate enough political power to manipulate the EV estimators and reward hack. In theory those economies shouldn’t interact. But it’s impossible to totally prevent it. The EV estimators are receiving big sets of action proposals from the decisionmakers and the decisionmakers will see which action proposal the EV estimators end up choosing.
Artificial agents can be copied or rolled back (erase memories), which makes it possible to reverse the receipt of information if an assessor concludes with a price that the seller considers too low for a deal.
Yepp, very good point. Am working on a short story about this right now.
I note that AI economies like this will often have explosively better credit assignment for information production than human economies can. Artificial agents can be copied or rolled back (erase memories), which makes it possible to reverse the receipt of information if an assessor concludes with a price that the seller considers too low for a deal. In human economies, that’s impossible, you can’t send a clone to value a piece of information then delete them if you decide not to buy that information (that’s too expensive/illegal) nor can you wipe their memory of the information (or, we don’t know how to do that), so the very basic requirement for trade, assessment prior to purchase, is not possible in human economies, so information doesn’t get priced accurately and it has to be treated as a public good.
When implementing this (internal privacy) in a multi-agent architecture, though, make sure to take measures to prevent the formation of monopolies, I feel like information is kind of an increasing returns type of good, yeah? The more you have the more you can do with it. It could quickly stop being multi-agent, and at worst, the monopoly could consolidate enough political power to manipulate the EV estimators and reward hack. In theory those economies shouldn’t interact. But it’s impossible to totally prevent it. The EV estimators are receiving big sets of action proposals from the decisionmakers and the decisionmakers will see which action proposal the EV estimators end up choosing.
Yepp, very good point. Am working on a short story about this right now.