Basically, if you’re looking for the shortest way from A to B (instrumental), you can’t find it unless your map is correct (epistemic) { or you’re incredibly lucky :-D }. So epistemic rationality is the foundation, base for the instrumental rationality.
I think that’s only the case insofar as we’re talking about “general instrumental rationality.” In practice lots of skills seem to be gained tacitly—in fact, I would say this is the default skill acquisition process.
One of the implications is that ceteris paribus it’s better to sacrifice instrumental for epistemic rather than epistemic for instrumental.
That seems to be a common assumption on LW, but I think it may not be a good one.
In practice lots of skills seem to be gained tacitly—in fact, I would say this is the default skill acquisition process.
Well, I think that at this point we’re venturing into the land of “it depends”. I would say that if you have “tacit” skills but the wrong map, you might instrumentally do well within the narrow domain where your misunderstood skills work, but you have a chance for a catastrophic failure once you venture outside of it. For example, you could perfectly well do some restricted thermodynamics using the idea of phlogiston. Or you can do astronomy on the basis of Ptolemaic epicycles. Both would work for certain kinds of problems but both would also fail once you try to expand.
And, seems to me, in most cases there is no trade-off and epistemic and instrumental rationality match each other—the process of discovering the shortest way from A to B simultaneously improves your map.
I would say that if you have “tacit” skills but the wrong map, you might instrumentally do well within the narrow domain where your misunderstood skills work, but you have a chance for a catastrophic failure once you venture outside of it.
I agree, and think this explains a large amount of human failure. I believe that nearly everyone relies on tacit skills for nearly everything and that whether “general instrumental rationality” even exists is by all means an open question.
I think that’s only the case insofar as we’re talking about “general instrumental rationality.” In practice lots of skills seem to be gained tacitly—in fact, I would say this is the default skill acquisition process.
That seems to be a common assumption on LW, but I think it may not be a good one.
Well, I think that at this point we’re venturing into the land of “it depends”. I would say that if you have “tacit” skills but the wrong map, you might instrumentally do well within the narrow domain where your misunderstood skills work, but you have a chance for a catastrophic failure once you venture outside of it. For example, you could perfectly well do some restricted thermodynamics using the idea of phlogiston. Or you can do astronomy on the basis of Ptolemaic epicycles. Both would work for certain kinds of problems but both would also fail once you try to expand.
And, seems to me, in most cases there is no trade-off and epistemic and instrumental rationality match each other—the process of discovering the shortest way from A to B simultaneously improves your map.
I agree, and think this explains a large amount of human failure. I believe that nearly everyone relies on tacit skills for nearly everything and that whether “general instrumental rationality” even exists is by all means an open question.