If you haven’t already (though I get the feeling you have), you should look up the various incarnations of the “No Free Lunch Theorem” by David Wolpert. Looks like there is a whole web site on it.
http://www.no-free-lunch.org/
He was my favorite theorist on generalization theory back when I was in graduate school. Couldn’t get enough of him and Jaynes.
If you haven’t already (though I get the feeling you have), you should look up the various incarnations of the “No Free Lunch Theorem” by David Wolpert. Looks like there is a whole web site on it.
http://www.no-free-lunch.org/
He was my favorite theorist on generalization theory back when I was in graduate school. Couldn’t get enough of him and Jaynes.