The word “optimization” seems to have a few different related meanings so perhaps it would be useful to lead with a definition. You may enjoy reading this post by Demski if you haven’t seen it.
Mathematical definition: Optimization is the process of finding the best possible solution to a problem, given a set of constraints.
Practical definition: Optimization is the process of improving the performance of a system, such as by minimizing costs, maximizing profits, or improving efficiency.
In my comment I focused on the second interpretation (by focussing on iteration). The first definition does not require a perfect model of the world.
In the real world we always have limited information and compute and so the best possible solution is always an approximation. The person with the most compute and information will probably optimize faster and win.
I agree that this is a very good post and it helps me sharpen my views.
Disclaimer: Low effort comment.
The word “optimization” seems to have a few different related meanings so perhaps it would be useful to lead with a definition. You may enjoy reading this post by Demski if you haven’t seen it.
Mathematical definition: Optimization is the process of finding the best possible solution to a problem, given a set of constraints.
Practical definition: Optimization is the process of improving the performance of a system, such as by minimizing costs, maximizing profits, or improving efficiency.
In my comment I focused on the second interpretation (by focussing on iteration). The first definition does not require a perfect model of the world.
In the real world we always have limited information and compute and so the best possible solution is always an approximation. The person with the most compute and information will probably optimize faster and win.
I agree that this is a very good post and it helps me sharpen my views.