When you drive to the supermarket, you aren’t really aiming for the supermarket, you’re aiming for a region of possible futures in which you don’t starve.
The first time you head to the supermarket it might be trying to stop starving, but after you have done it for a few times, it becomes an in grained habit. And you might be heading to the super market, because you always head to the super market on a saturday. You might do so even if it becomes knowably sub optimal for starvation prevention, because you aren’t re-evaluating the economics of doing so.
This is a known and exploited facet of humans, hence special offers to get you buying food for a bit, to hope it becomes a habit.
I however sometimes spend far too long making food buying decisions (i.e. more time spent if I was working for that time than I might save).
If your AI was making a decision to buy bread vs making it would it calculate the nutrition of store bought bread, cost of petrol and bread, wear and tear on the car etc vs the time taken to make bread, energy costs of cooking it, ingredient costs, wear and tear on oven, cost to repair or replace oven etc every time one of these values changed or would it use cached results?
Of course if the AI was going to be truly powerful it would be able to predict the secondary effects of choices it made, would the money it spent in avoiding starvation be in the hands of other people trying to avoid starvation of people in general, i.e. giving it to people spending it to encourage research and actions that lead to the avoidance of food shortages in the future (either through lobbying government or directly depending what was more influential). I sometimes feel I need a very Powerful AGI just to buy my groceries.
The first time you head to the supermarket it might be trying to stop starving, but after you have done it for a few times, it becomes an in grained habit. And you might be heading to the super market, because you always head to the super market on a saturday. You might do so even if it becomes knowably sub optimal for starvation prevention, because you aren’t re-evaluating the economics of doing so.
This is a known and exploited facet of humans, hence special offers to get you buying food for a bit, to hope it becomes a habit.
I however sometimes spend far too long making food buying decisions (i.e. more time spent if I was working for that time than I might save).
If your AI was making a decision to buy bread vs making it would it calculate the nutrition of store bought bread, cost of petrol and bread, wear and tear on the car etc vs the time taken to make bread, energy costs of cooking it, ingredient costs, wear and tear on oven, cost to repair or replace oven etc every time one of these values changed or would it use cached results?
Of course if the AI was going to be truly powerful it would be able to predict the secondary effects of choices it made, would the money it spent in avoiding starvation be in the hands of other people trying to avoid starvation of people in general, i.e. giving it to people spending it to encourage research and actions that lead to the avoidance of food shortages in the future (either through lobbying government or directly depending what was more influential). I sometimes feel I need a very Powerful AGI just to buy my groceries.