This was a very fun article. Notably absent from the list, even though I would absolutely have expected it (since the focus was on evolutionary algorithms, even though many observations also apply to gradient-descent):
Driving genes. Biologically, a “driving gene” is one that cheats in (sexual) evolution, by ensuring that it is present in >50% of offspring, usually by weirdly interacting with the machinery that does meiosis.
In artificial evolution that uses “combination”, “mutation” and “selection”, these would be regions of parameter-space that are attracting under “combination”-dynamics, and use that to beat selection pressure.
This was a very fun article. Notably absent from the list, even though I would absolutely have expected it (since the focus was on evolutionary algorithms, even though many observations also apply to gradient-descent):
Driving genes. Biologically, a “driving gene” is one that cheats in (sexual) evolution, by ensuring that it is present in >50% of offspring, usually by weirdly interacting with the machinery that does meiosis.
In artificial evolution that uses “combination”, “mutation” and “selection”, these would be regions of parameter-space that are attracting under “combination”-dynamics, and use that to beat selection pressure.