It is worth considering that in the context of power, regulations are merely a form of incentive. Compare to the pre-commitment strategies we often discuss.
In the early history of the firm we saw examples of businesses exceeding state power all the time. For example, the British East India company in India, American shipping companies in Nicaragua, United Fruit in Guatemala. In current affairs, companies like Nestle and Coca-cola are accused of violently enforcing their interests in Africa. I am confident that given attention, we either would find or will soon misbehavior of a similar nature from Chinese firms. And this is only a comparison against states; local governments get run over roughshod routinely, exactly as we would expect from comparing their available resources.
OThe intuition is that all possible agents are competing in the same field, which is reality. The extent to which they understand the field makes it an information game of sorts. I think this means the fundamental limits on AGI are the same as any other variety of agent: the cost in time and resources of integrating new information. We just expect both of these costs to be very low relative to other agents, and therefore the threat is high.
It is worth considering that in the context of power, regulations are merely a form of incentive. Compare to the pre-commitment strategies we often discuss.
In the early history of the firm we saw examples of businesses exceeding state power all the time. For example, the British East India company in India, American shipping companies in Nicaragua, United Fruit in Guatemala. In current affairs, companies like Nestle and Coca-cola are accused of violently enforcing their interests in Africa. I am confident that given attention, we either would find or will soon misbehavior of a similar nature from Chinese firms. And this is only a comparison against states; local governments get run over roughshod routinely, exactly as we would expect from comparing their available resources.
OThe intuition is that all possible agents are competing in the same field, which is reality. The extent to which they understand the field makes it an information game of sorts. I think this means the fundamental limits on AGI are the same as any other variety of agent: the cost in time and resources of integrating new information. We just expect both of these costs to be very low relative to other agents, and therefore the threat is high.