I’m not really worried given the expected effect size. e.g. let’s say by the time I’d be ready to use such tech, the best known interventions have an EV of +10 IQ points. Well the world already has a significant number of humans with 10 more IQ points than me (and a significant number in a range on both sides of that); obviously I haven’t done real studies on this but my vague impression looking around at those existing people is that the extra IQ points don’t on average trade off against other things I care about. (It’s possible that I’m wrong about existing humans, or that I’m right but that tech selecting for IQ points does involve a trade-off I wouldn’t accept if I knew about it.)
I haven’t thought much about how worried I’d be if we’re talking about much more extreme IQ gains. Certainly in the limit, if you told me my kid would have +100000 IQ points, I mean my first response is that you’re lying, but yeah if I believed it I’d be worried for similar reasons that one worries about ASI.
Also I realize I was talking about (at expected effect size) whether there’s a trade-off at all to gaining more IQ, but to be clear even if there is a trade-off (or uncertainty about the trade-off) it is still probably worth it up to some point—I certainly don’t think that we should only augment intelligence if we can prove it is literally costless.
I’m not really worried given the expected effect size. e.g. let’s say by the time I’d be ready to use such tech, the best known interventions have an EV of +10 IQ points. Well the world already has a significant number of humans with 10 more IQ points than me (and a significant number in a range on both sides of that); obviously I haven’t done real studies on this but my vague impression looking around at those existing people is that the extra IQ points don’t on average trade off against other things I care about. (It’s possible that I’m wrong about existing humans, or that I’m right but that tech selecting for IQ points does involve a trade-off I wouldn’t accept if I knew about it.)
I haven’t thought much about how worried I’d be if we’re talking about much more extreme IQ gains. Certainly in the limit, if you told me my kid would have +100000 IQ points, I mean my first response is that you’re lying, but yeah if I believed it I’d be worried for similar reasons that one worries about ASI.
Also I realize I was talking about (at expected effect size) whether there’s a trade-off at all to gaining more IQ, but to be clear even if there is a trade-off (or uncertainty about the trade-off) it is still probably worth it up to some point—I certainly don’t think that we should only augment intelligence if we can prove it is literally costless.