[copying the reply here because I don’t like looking at the facebook popup]
(I usually do agree with Scott Alexander on almost everything, so it’s only when he says something I particularly disagree with that I ever bother to broadcast it. Don’t let that selection bias give you a misleading picture of our degree of general agreement. #long)
I think Scott Alexander is wrong that we should regret our collective failure to invest early in cryptocurrency. This is very low on my list of things to kick ourselves about. I do not consider it one of my life’s regrets, a place where I could have done better.
Sure, Clippy posted to LW in 2011 about Bitcoin back when Bitcoins were $1 apiece, and gwern gave an argument for why Bitcoin had a 0.5% probability of going to $5,000 and that this made it a good investment to run your GPU to mine Bitcoins, and Wei Dai commented that in this case you could just buy Bitcoin directly. I don’t remember reading that post, it wasn’t promoted, and gwern’s comment was only upvoted by 3 points; but it happened. I do think I heard about Bitcoin again on LW later, so I won’t press the point.
I do not consider our failure to buy in as a failure of group or individual rationality.
A very obvious reply is that of efficient markets. There were lots and lots of people in the world who want money, who specialize in getting more money, who invest a lot of character points in doing that. Some of them knew about cryptocurrency, even. Almost all of them did the same thing we did and stayed out of Bitcoin—by the time even 0.1% of them had bought in, the price had thereby gone higher. At worst we are no less capable than 99.9% of those specialists.
Now, it is sometimes possible to do better than all of the professionals, under the kinds of circumstances that I talk about in Inadequate Equilibria. But when the professionals can act unilaterally and only need to invest a couple of hundred bucks to grab the low-hanging fruit, that is not by default favorable conditions for beating them.
Could all the specialists have a blind spot en masse that you see through? Could your individual breadth of knowledge and depth of sanity top their best efforts even when they’re not gummed up in systemic glue? Well, I think I can sometimes pull off that kind of hat trick. But it’s not some kind of enormous surprise when you don’t. It’s not the kind of thing that means you should have a crisis of faith in yourself and your skills.
To put it another way, the principle “Rationalists should win” does not translate into “Bounded rationalists should expect to routinely win harder than prediction markets and kick themselves when they don’t.”
You want to be careful about what excuses you give yourself. You don’t want to update in the opposite direction of experience, you don’t want to reassure yourself so hard that you anti-learn when somebody else does better. But some other people’s successes should give you only a tiny delta toward trying to imitate them. Financial markets are just about the worst place to think that you ought to learn from your mistake in having not bought something.
Back when Bitcoin was gaining a little steam for the first time, enough that nerds were starting to hear about it, I said to myself back then that it wasn’t my job to think about cryptocurrency. Or about clever financial investment in general. I thought that actually winning there would take a lot of character points I didn’t have to spare, if I could win at all. I thought that it was my job to go off and solve AI alignment, that I was doing my part for Earth using my own comparative advantage; and that if there was really some low-hanging investment fruit somewhere, somebody else needed to go off and investigate it and then donate to MIRI later if it worked out.
I think that this pattern of thought in general may have been a kind of wishful thinking, a kind of argument from consequences, which I do regret. In general, there isn’t anyone else doing their part, and I wish I’d understood that earlier to a greater degree. But that pattern of thought didn’t actually fail with respect to cryptocurrency. In 2017, around half of MIRI’s funding came from cryptocurrency donations. That part more or less worked.
More generally, I worry Scott Alexander may be succumbing to hindsight bias here. I say this with hesitation, because Scott has his own skillz; but I think Scott might be looking back and seeing a linear path of reasoning where in fact there would have been a garden of forking paths.
Or as I put it to myself when I felt briefly tempted to regret: “Gosh, I sure do wish that I’d advised everyone to buy in at Bitcoin at $1, hold it at $10, keep holding it at $100, sell at $800 right before the Mt. Gox crash, invest the proceeds in Ethereum, then hold Ethereum until it rose to $1000.”
The idea of “rationality” is that we can talk about general, abstract algorithms of cognition which tend to produce better or worse results. If there’s no general thinking pattern that produces a systematically better result, you were perfectly rational. If there’s no thinking pattern a human can realistically adopt that produces a better result, you were about as sane as a human gets. We don’t say, “Gosh, I sure do wish I’d bought the Mega Millions ticket for 01-04-14-17-40-04* yesterday.” We don’t say, “Rationalists should win the lottery.”
What thought pattern would have generated the right answer here, without generating a lot of wrong answers in other places if you had to execute it without benefit of hindsight?
Have less faith in the market professionals? Michael Arc née Vassar would be the go-to example of somebody who would have told you, at that time, that Eliezer-2011 vastly overestimates the competence of the rest of the world. He didn’t invest in cryptocurrency, and then hold until the right time, so far as I know.
Be more Pascal’s Muggable? But then you’d have earlier invested in three or four other supposed 5,000x returns, lost out on them, gotten discouraged, and just shaken your head at Bitcoin by the time it came around. There’s no such thing as advising your past self to only be Pascal’s Muggable for Bitcoin, to grant enough faith to just that one opportunity for 5,000x gains, and not pay equal amounts of money into any of the other supposed opportunities for 5,000x gains that you encountered.
I don’t see a simple, generally valid cognitive strategy that I could have executed to buy Bitcoin and hold it, without making a lot of other mistakes.
Not only am I not kicking myself, I’d worry about somebody trying to learn lessons from this. Before Scott Alexander wrote that post, I think I said somewhere—possibly Facebook?--that if you can’t manage to not regret having not bought Bitcoin even though you knew about it when it was $1, you shouldn’t ever buy anything except index funds because you are not psychologically suited to survive investing.
Though I find it amusing to be sure that the LessWrong forum had a real-life Pascal’s Mugging that paid out—of which the real lesson is of course that you ought to be careful as to what you imagine has a tiny probability.
EDIT: This is NOT me saying that anyone who did buy in early was irrational. That would be “updating in the wrong direction” indeed! More like, a bounded rationalist should not expect to win at everything at once; and looking back and thinking you ought to have gotten all the fruits that look easy in hindsight can lead to distorted thought patterns.
This is pretty low on the list of opportunities I’d kick myself for missing. A longer reply is here: https://www.facebook.com/yudkowsky/posts/10156147605134228
[copying the reply here because I don’t like looking at the facebook popup]
(I usually do agree with Scott Alexander on almost everything, so it’s only when he says something I particularly disagree with that I ever bother to broadcast it. Don’t let that selection bias give you a misleading picture of our degree of general agreement. #long)
I think Scott Alexander is wrong that we should regret our collective failure to invest early in cryptocurrency. This is very low on my list of things to kick ourselves about. I do not consider it one of my life’s regrets, a place where I could have done better.
Sure, Clippy posted to LW in 2011 about Bitcoin back when Bitcoins were $1 apiece, and gwern gave an argument for why Bitcoin had a 0.5% probability of going to $5,000 and that this made it a good investment to run your GPU to mine Bitcoins, and Wei Dai commented that in this case you could just buy Bitcoin directly. I don’t remember reading that post, it wasn’t promoted, and gwern’s comment was only upvoted by 3 points; but it happened. I do think I heard about Bitcoin again on LW later, so I won’t press the point.
I do not consider our failure to buy in as a failure of group or individual rationality.
A very obvious reply is that of efficient markets. There were lots and lots of people in the world who want money, who specialize in getting more money, who invest a lot of character points in doing that. Some of them knew about cryptocurrency, even. Almost all of them did the same thing we did and stayed out of Bitcoin—by the time even 0.1% of them had bought in, the price had thereby gone higher. At worst we are no less capable than 99.9% of those specialists.
Now, it is sometimes possible to do better than all of the professionals, under the kinds of circumstances that I talk about in Inadequate Equilibria. But when the professionals can act unilaterally and only need to invest a couple of hundred bucks to grab the low-hanging fruit, that is not by default favorable conditions for beating them.
Could all the specialists have a blind spot en masse that you see through? Could your individual breadth of knowledge and depth of sanity top their best efforts even when they’re not gummed up in systemic glue? Well, I think I can sometimes pull off that kind of hat trick. But it’s not some kind of enormous surprise when you don’t. It’s not the kind of thing that means you should have a crisis of faith in yourself and your skills.
To put it another way, the principle “Rationalists should win” does not translate into “Bounded rationalists should expect to routinely win harder than prediction markets and kick themselves when they don’t.”
You want to be careful about what excuses you give yourself. You don’t want to update in the opposite direction of experience, you don’t want to reassure yourself so hard that you anti-learn when somebody else does better. But some other people’s successes should give you only a tiny delta toward trying to imitate them. Financial markets are just about the worst place to think that you ought to learn from your mistake in having not bought something.
Back when Bitcoin was gaining a little steam for the first time, enough that nerds were starting to hear about it, I said to myself back then that it wasn’t my job to think about cryptocurrency. Or about clever financial investment in general. I thought that actually winning there would take a lot of character points I didn’t have to spare, if I could win at all. I thought that it was my job to go off and solve AI alignment, that I was doing my part for Earth using my own comparative advantage; and that if there was really some low-hanging investment fruit somewhere, somebody else needed to go off and investigate it and then donate to MIRI later if it worked out.
I think that this pattern of thought in general may have been a kind of wishful thinking, a kind of argument from consequences, which I do regret. In general, there isn’t anyone else doing their part, and I wish I’d understood that earlier to a greater degree. But that pattern of thought didn’t actually fail with respect to cryptocurrency. In 2017, around half of MIRI’s funding came from cryptocurrency donations. That part more or less worked.
More generally, I worry Scott Alexander may be succumbing to hindsight bias here. I say this with hesitation, because Scott has his own skillz; but I think Scott might be looking back and seeing a linear path of reasoning where in fact there would have been a garden of forking paths.
Or as I put it to myself when I felt briefly tempted to regret: “Gosh, I sure do wish that I’d advised everyone to buy in at Bitcoin at $1, hold it at $10, keep holding it at $100, sell at $800 right before the Mt. Gox crash, invest the proceeds in Ethereum, then hold Ethereum until it rose to $1000.”
The idea of “rationality” is that we can talk about general, abstract algorithms of cognition which tend to produce better or worse results. If there’s no general thinking pattern that produces a systematically better result, you were perfectly rational. If there’s no thinking pattern a human can realistically adopt that produces a better result, you were about as sane as a human gets. We don’t say, “Gosh, I sure do wish I’d bought the Mega Millions ticket for 01-04-14-17-40-04* yesterday.” We don’t say, “Rationalists should win the lottery.”
What thought pattern would have generated the right answer here, without generating a lot of wrong answers in other places if you had to execute it without benefit of hindsight?
Have less faith in the market professionals? Michael Arc née Vassar would be the go-to example of somebody who would have told you, at that time, that Eliezer-2011 vastly overestimates the competence of the rest of the world. He didn’t invest in cryptocurrency, and then hold until the right time, so far as I know.
Be more Pascal’s Muggable? But then you’d have earlier invested in three or four other supposed 5,000x returns, lost out on them, gotten discouraged, and just shaken your head at Bitcoin by the time it came around. There’s no such thing as advising your past self to only be Pascal’s Muggable for Bitcoin, to grant enough faith to just that one opportunity for 5,000x gains, and not pay equal amounts of money into any of the other supposed opportunities for 5,000x gains that you encountered.
I don’t see a simple, generally valid cognitive strategy that I could have executed to buy Bitcoin and hold it, without making a lot of other mistakes.
Not only am I not kicking myself, I’d worry about somebody trying to learn lessons from this. Before Scott Alexander wrote that post, I think I said somewhere—possibly Facebook?--that if you can’t manage to not regret having not bought Bitcoin even though you knew about it when it was $1, you shouldn’t ever buy anything except index funds because you are not psychologically suited to survive investing.
Though I find it amusing to be sure that the LessWrong forum had a real-life Pascal’s Mugging that paid out—of which the real lesson is of course that you ought to be careful as to what you imagine has a tiny probability.
EDIT: This is NOT me saying that anyone who did buy in early was irrational. That would be “updating in the wrong direction” indeed! More like, a bounded rationalist should not expect to win at everything at once; and looking back and thinking you ought to have gotten all the fruits that look easy in hindsight can lead to distorted thought patterns.