I don’t have any experience with data centers or with deploying machine learning at scale. However, I would expect that for performance reasons it is much more efficient to have a local cache of the current data and then either have a manual redeploy at a fixed schedule or have the software refresh the cache automatically after some amount of time.
I would also imagine that reacting immediately could result in feedback loops where the AI overreacts to recent actions.
I don’t have any experience with data centers or with deploying machine learning at scale. However, I would expect that for performance reasons it is much more efficient to have a local cache of the current data and then either have a manual redeploy at a fixed schedule or have the software refresh the cache automatically after some amount of time.
I would also imagine that reacting immediately could result in feedback loops where the AI overreacts to recent actions.