OK, but why would the sentence start with “Many EAs value future people roughly as much as currently-living people” if there wasn’t an implied inferential connection to nearly all value being found in astronomical far future populations? The “therefore” is still implicitly present.
It’s not entirely without justification, though. It’s true that the rejection of a (very heavy) presentist time preference/bias is necessary for Bostrom’s and Beckstead’s conclusions. So there’s weak justification for your “therefore”: The rejection of presentist time preference makes the conclusions more likely.
But it’s by no means sufficient for them. Bostrom and Beckstead need the further claim that bringing new people into existence is morally important and urgent.
This seems to be the crucial point. So I’d rather go for something like: “Many (Some?) EAs value/think it morally urgent to bring new people (with lives worth living) into existence, and therefore...”
The moral urgency of preventing miserable lives (or life-moments) is less controversial. People like Brian Tomasik place much more (or exclusive) importance on the prevention of lives not worth living, i.e. on ensuring the well-being of everyone that will exist rather than on making as many people exist as possible. The issue is not whether (far) future lives count as much as lives closer to the present. One can agree that future lives count equally, and also agree that far future considerations dominate the moral calculation (empirical claims enter the picture here). But one may disagree on “Omelas and Space Colonization”, i.e. on how many lives worth living are needed to “outweigh” or “compensate for” miserable ones (which our future existence will inevitably also produce, probably in astronomical numbers, assuming astronomical population expansion). So it’s possible to agree that future lives count equally and that far future considerations dominate but to still disagree on the importance of x-risk reduction or more particular things such as space colonization.
But one may disagree on “Omelas and Space Colonization”, i.e. on how many lives worth living are needed to “outweigh” or “compensate for” miserable ones (which our future existence will inevitably also produce, probably in astronomical numbers, assuming astronomical population expansion).
A superintelligent Singleton (e.g., FAI) can guarantee a minimum standard of living for everyone who will ever be born or created, so I don’t understand why you think astronomical population expansion inevitably produces miserable lives.
Also, I note that space colonization can produce an astronomical number of QALYs even assuming no population growth, by letting currently existing people continue to live after all the negentropy in our solar system has been exhausted.
Yes, it can. But a Singleton is not guaranteed; and conditional on the future existence of a Singleton, friendliness is not guaranteed. What I meant was that astronomical population expansion clearly produces an astronomical number of most miserable, tortured lives in expectation.
Lots of dystopian future scenarios are possible. Here are some of them.
How many happy people for one miserable existence? - I take the zero option very seriously because I don’t think that (anticipated) non-existence poses any moral problem or generates any moral urgency to act, while (anticipated) miserable existence clearly does. I don’t think it would have been any intrinsic problem whatsoever had I never been born; but it clearly would have been a problem had I been born into miserable circumstances.
But even if you do believe that non-existence poses a moral problem and creates an urgency to act, it’s not clear yet that the value of the future is net positive. If the number of happy people you require for one miserable existence is sufficiently great and/or if dystopian scenarios are sufficiently likely, the future will be negative in expectation. Beware optimism bias, illusion of control, etc.
Lots of dystopian future scenarios are possible. Here are some of them.
But even if you do believe that non-existence poses a moral problem and creates an urgency to act, it’s not clear yet that the value of the future is net positive.
Even Brian Tomasik, the author of that page, says that if one trades off pain and pleasure at ordinary rates the expected happiness of the future exceeds the expected suffering, by a factor of between 2 and 50.
The 2-50 bounds seem reasonable for EV(happiness)/EV(suffering) using normal people’s pleasure-pain exchange ratios, which I think are insane. :) Something like accepting 1 minute of Medieval torture for a few days/weeks of good life.
Using my own pleasure-pain exchange ratio, the future is almost guaranteed to be negative in expectation, although I maintain ~30% chance that it would still be better for Earth-based life to colonize space to prevent counterfactual suffering elsewhere.
It is worth pointing out that by ‘insane’, Brian just means ‘an exchange rate that is very different from the one I happen to endorse.’ :-) He admits that there is no reason to favor his own exchange rate over other people’s. (By contrast, some of these other people would argue that there are reasons to favor their exchange rates over Brian’s.)
That’s incorrect. David Pearce claims that pains below a certain intensity can’t be outweighed by any amount of pleasure. Both Brian and Dave agree that Dave is a (threshold) negative utilitarian whereas Brian is a negative-leaning utilitarian.
Not so sure. Dave believes that pains have an “ought-not-to-be-in-the-world-ness” property that pleasures lack. And in the discussions I have seen, he indeed was not prepared to accept that small pains can be outweighed by huge quantities of pleasure.
Brian was oscillating between NLU and NU. He recently told me he found the claim convincing that such states as flow, orgasm, meditative tranquility, perfectly subjectively fine muzak, and the absence of consciousness were all equally good.
Can preference utilitarians, classical utilitarians and negative utilitarians hammer out some kind of cosmological policy consensus? Not ideal by anyone’s lights, but good enough? So long as we don’t create more experience below “hedonic zero” in our forward light-cone, NUs are untroubled by wildly differing outcomes. There is clearly a tension between preference utilitarianism and classical utilitarianism; but most(?) preference utilitarians are relaxed about having hedonic ranges shifted upwards—perhaps even radically upwards—if recalibration is done safely, intelligently and conservatively—a big “if”, for sure. Surrounding the sphere of sentient agents in our Local Supercluster(?) with a sea of hedonium propagated by von Neumann probes or whatever is a matter of indifference to most preference utilitarians and NUs but mandated(?) by CU.
Regarding “people’s ordinary exchange rates”, I suspect that in cases people clearly recognize as altruistic, the rates are closer to Brian’s than to yours. In cases they (IMO confusedly) think of as “egoistic”, the rates may be closer to yours. - This provides an argument that people should end up with Brian upon knocking out confusion.
I suspect that in cases people clearly recognize as altruistic, the rates are closer to Brian’s than to yours.
Which cases did you have in mind?
People generally don’t altruistically favor euthanasia for pets with temporarily painful but easily treatable injuries (where recovery could be followed with extended healthy life). People are not eager to campaign to stop the pain of childbirth at the expense of birth. They don’t consider a single instance of torture worse than many deaths depriving people of happy lives. They favor bringing into being the lives of children that will contain some pain.
Thanks for the explanation. I was thrown by your usage of the word “inevitable” earlier, but I think I understand your position now. (EDIT: Deleted rest of this comment which makes a point that you already discussing with Nick Beckstead.)
Right, the first clause is there as a necessary but not sufficient part of the standard reason for focusing on the far future, and the sentence works now that I’ve removed the “therefore.”
The reason I’d rather not phrase things as “morally urgent to bring new people into existence” is because that phrasing suggests presentist assumptions. I’d rather use a sentence with non-presentist assumptions, since presentism is probably rejected by a majority of physicists by now, and also rejected by me. (It’s also rejected by the majority of EAs with whom I’ve discussed the issue, but that’s not actually noteworthy because it’s such a biased sample of EAs.)
Is it the “bringing into existence” and the “new” that suggests presentism to you? (Which I also reject, btw. But I don’t think it’s of much relevance to the issue at hand.) Even without the “therefore”, it seems to me that the sentence suggests that the rejection of time preference is what does the crucial work on the way to Bostrom’s and Beckstead’s conclusions, when it’s rather the claim that it’s “morally urgent/required to cause the existence of people (with lives worth living) that wouldn’t otherwise have existed”, which is what my alternative sentence was meant to mean.
I confess I’m not that motivated to tweak the sentence even further, since it seems like a small semantic point, I don’t understand the advantages to your phrasing, and I’ve provided links to more thorough discussions of these issues, for example Beckstead’s dissertation. Maybe it would help if you explained what kind of reasoning you are using to identify which claims are “doing the crucial work”? Or we could just let it be.
Yeah, I’ve read Nick’s thesis, and I think the moral urgency of filling the universe with people is the more important basis of his conclusion than the rejection of time preference. The sentence suggests that the rejection of time preference is most important.
If I get him right, Nick agrees that the time issue is much less important than you suggested in your recent interview.
Sorry to insist! :) But when you disagree with Bostrom’s and Beckstead’s conclusions, people immediately assume that you must be valuing present people more than future ones. And I’m constantly like: “No! The crucial issue is whether the non-existence of people (where there could be some) poses a moral problem, i.e. whether it’s morally urgent to fill the universe with people. I doubt it.”
Okay, so we’re talking about two points: (1) whether current people have more value than future people, and (2) whether it would be super-good to create gazillions of super-good lives.
My sentence mentions both of those, in sequence: “Many EAs value future people roughly as much as currently-living people [1], and think that nearly all potential value is found in the well-being of the astronomical numbers of people who could populate the far future [2]...”
And you are suggesting… what? That I switch the order in which they appear, so that [2] appears before [1], and is thus emphasized? Or that I use your phrase “morally urgent to” instead of “nearly all potential value is found in...”? Or something else?
I forgot to clarify the rough argument for why (1) “value future people equally” is much less important or crucial than (2) “fill the universe with people” here.
If you accept (2), you’re almost guaranteed to be on board with where Bostrom and Beckstead are roughly going (even if you valued present people more!). It’s hardly possible to then block their argument on normative grounds, and criticism would have to be empirical, e.g. based on the claim that dystopian futures may be likelier than commonly assumed, which would decrease the value of x-risk reduction.
By contrast, if you accept (1), it’s still very much an open question whether you’ll be on board.
Also, intrinsic time preference is really not an issue among EAs. The idea that spatial and temporal distance are irrelevant when it comes to helping others is a pretty core element of the EA concept. What is an issue, though, is the question of what helping others actually means (or should mean). Who are the relevant others? Persons? Person-moments? Preferences? And how are they relevant? Should we ensure the non-existence of suffering? Or promote ecstasy too? Prevent the existence of unfulfilled preferences? Or create fulfilled ones too? Can you help someone by bringing them into existence? Or only by preventing their miserable existence/unfulfilled preferences? These issues are more controversial than the question of time preference. Unfortunately, they’re of astronomical significance.
I don’t really know if I’m suggesting any further specific change to the wording—sorry about that. It’s tricky… If you’re speaking to non-EAs, it’s important to emphasize the rejection of time preference. But there shouldn’t be a “therefore”, which (in my perception) is still implicitly there. And if you’re speaking to people who already reject time preference, it’s even more important to make it clear that this rejection doesn’t imply “fill the universe with people”. One solution could be to simply drop the reference to the (IMO non-decisive) rejection of time preference and go for something like: “Many EAs consider the creation of (happy) people valuable and morally urgent, and therefore think that nearly all potential value...”
Beckstead might object that the rejection of heavy time preference is important to his general conclusion (the overwhelming importance of shaping the far future). But if we’re talking that level of generality, then the reference to x-risk reduction should probably go or be qualified. For sufficiently negative-leaning EAs (such as Brian Tomasik) believe that x-risk reduction is net negative.
Perhaps the best solution would be to expand the section and start by mentioning how the (EA-uncontroversial) rejection of time preference is relevant to the overwhelming importance of shaping the far future. Once we’ve established that the far future likely dominates, the question arises how we should morally affect the far future. Depending on this question, very different conclusions can result e.g. with regard to the importance and even the sign of x-risk reduction.
I don’t want to expand the section, because that makes it stand out more than is compatible with my aims for the post. And since the post is aimed at non-EAs and new EAs, I don’t want to drop the point about time preference, as “intrinsic” time-discounting is a common view outside EA, especially for those with a background in economics rather than philosophy. So my preferred solution is to link to a fuller discussion of the issues, which I did (in particular, Beckstead’s thesis). Anyway, I appreciate your comments.
Okay, I removed the “therefore.”
OK, but why would the sentence start with “Many EAs value future people roughly as much as currently-living people” if there wasn’t an implied inferential connection to nearly all value being found in astronomical far future populations? The “therefore” is still implicitly present.
It’s not entirely without justification, though. It’s true that the rejection of a (very heavy) presentist time preference/bias is necessary for Bostrom’s and Beckstead’s conclusions. So there’s weak justification for your “therefore”: The rejection of presentist time preference makes the conclusions more likely.
But it’s by no means sufficient for them. Bostrom and Beckstead need the further claim that bringing new people into existence is morally important and urgent.
This seems to be the crucial point. So I’d rather go for something like: “Many (Some?) EAs value/think it morally urgent to bring new people (with lives worth living) into existence, and therefore...”
The moral urgency of preventing miserable lives (or life-moments) is less controversial. People like Brian Tomasik place much more (or exclusive) importance on the prevention of lives not worth living, i.e. on ensuring the well-being of everyone that will exist rather than on making as many people exist as possible. The issue is not whether (far) future lives count as much as lives closer to the present. One can agree that future lives count equally, and also agree that far future considerations dominate the moral calculation (empirical claims enter the picture here). But one may disagree on “Omelas and Space Colonization”, i.e. on how many lives worth living are needed to “outweigh” or “compensate for” miserable ones (which our future existence will inevitably also produce, probably in astronomical numbers, assuming astronomical population expansion). So it’s possible to agree that future lives count equally and that far future considerations dominate but to still disagree on the importance of x-risk reduction or more particular things such as space colonization.
A superintelligent Singleton (e.g., FAI) can guarantee a minimum standard of living for everyone who will ever be born or created, so I don’t understand why you think astronomical population expansion inevitably produces miserable lives.
Also, I note that space colonization can produce an astronomical number of QALYs even assuming no population growth, by letting currently existing people continue to live after all the negentropy in our solar system has been exhausted.
Yes, it can. But a Singleton is not guaranteed; and conditional on the future existence of a Singleton, friendliness is not guaranteed. What I meant was that astronomical population expansion clearly produces an astronomical number of most miserable, tortured lives in expectation.
Lots of dystopian future scenarios are possible. Here are some of them.
How many happy people for one miserable existence? - I take the zero option very seriously because I don’t think that (anticipated) non-existence poses any moral problem or generates any moral urgency to act, while (anticipated) miserable existence clearly does. I don’t think it would have been any intrinsic problem whatsoever had I never been born; but it clearly would have been a problem had I been born into miserable circumstances.
But even if you do believe that non-existence poses a moral problem and creates an urgency to act, it’s not clear yet that the value of the future is net positive. If the number of happy people you require for one miserable existence is sufficiently great and/or if dystopian scenarios are sufficiently likely, the future will be negative in expectation. Beware optimism bias, illusion of control, etc.
Even Brian Tomasik, the author of that page, says that if one trades off pain and pleasure at ordinary rates the expected happiness of the future exceeds the expected suffering, by a factor of between 2 and 50.
The 2-50 bounds seem reasonable for EV(happiness)/EV(suffering) using normal people’s pleasure-pain exchange ratios, which I think are insane. :) Something like accepting 1 minute of Medieval torture for a few days/weeks of good life.
Using my own pleasure-pain exchange ratio, the future is almost guaranteed to be negative in expectation, although I maintain ~30% chance that it would still be better for Earth-based life to colonize space to prevent counterfactual suffering elsewhere.
It is worth pointing out that by ‘insane’, Brian just means ‘an exchange rate that is very different from the one I happen to endorse.’ :-) He admits that there is no reason to favor his own exchange rate over other people’s. (By contrast, some of these other people would argue that there are reasons to favor their exchange rates over Brian’s.)
Also, still others (such as David Pearce) would argue that there are reasons to favor Brian’s exchange rate. :)
That’s incorrect. David Pearce claims that pains below a certain intensity can’t be outweighed by any amount of pleasure. Both Brian and Dave agree that Dave is a (threshold) negative utilitarian whereas Brian is a negative-leaning utilitarian.
Not so sure. Dave believes that pains have an “ought-not-to-be-in-the-world-ness” property that pleasures lack. And in the discussions I have seen, he indeed was not prepared to accept that small pains can be outweighed by huge quantities of pleasure. Brian was oscillating between NLU and NU. He recently told me he found the claim convincing that such states as flow, orgasm, meditative tranquility, perfectly subjectively fine muzak, and the absence of consciousness were all equally good.
Can preference utilitarians, classical utilitarians and negative utilitarians hammer out some kind of cosmological policy consensus? Not ideal by anyone’s lights, but good enough? So long as we don’t create more experience below “hedonic zero” in our forward light-cone, NUs are untroubled by wildly differing outcomes. There is clearly a tension between preference utilitarianism and classical utilitarianism; but most(?) preference utilitarians are relaxed about having hedonic ranges shifted upwards—perhaps even radically upwards—if recalibration is done safely, intelligently and conservatively—a big “if”, for sure. Surrounding the sphere of sentient agents in our Local Supercluster(?) with a sea of hedonium propagated by von Neumann probes or whatever is a matter of indifference to most preference utilitarians and NUs but mandated(?) by CU.
Is this too rosy a scenario?
Regarding “people’s ordinary exchange rates”, I suspect that in cases people clearly recognize as altruistic, the rates are closer to Brian’s than to yours. In cases they (IMO confusedly) think of as “egoistic”, the rates may be closer to yours. - This provides an argument that people should end up with Brian upon knocking out confusion.
Which cases did you have in mind?
People generally don’t altruistically favor euthanasia for pets with temporarily painful but easily treatable injuries (where recovery could be followed with extended healthy life). People are not eager to campaign to stop the pain of childbirth at the expense of birth. They don’t consider a single instance of torture worse than many deaths depriving people of happy lives. They favor bringing into being the lives of children that will contain some pain.
Thanks for the explanation. I was thrown by your usage of the word “inevitable” earlier, but I think I understand your position now. (EDIT: Deleted rest of this comment which makes a point that you already discussing with Nick Beckstead.)
Right, the first clause is there as a necessary but not sufficient part of the standard reason for focusing on the far future, and the sentence works now that I’ve removed the “therefore.”
The reason I’d rather not phrase things as “morally urgent to bring new people into existence” is because that phrasing suggests presentist assumptions. I’d rather use a sentence with non-presentist assumptions, since presentism is probably rejected by a majority of physicists by now, and also rejected by me. (It’s also rejected by the majority of EAs with whom I’ve discussed the issue, but that’s not actually noteworthy because it’s such a biased sample of EAs.)
Is it the “bringing into existence” and the “new” that suggests presentism to you? (Which I also reject, btw. But I don’t think it’s of much relevance to the issue at hand.) Even without the “therefore”, it seems to me that the sentence suggests that the rejection of time preference is what does the crucial work on the way to Bostrom’s and Beckstead’s conclusions, when it’s rather the claim that it’s “morally urgent/required to cause the existence of people (with lives worth living) that wouldn’t otherwise have existed”, which is what my alternative sentence was meant to mean.
I confess I’m not that motivated to tweak the sentence even further, since it seems like a small semantic point, I don’t understand the advantages to your phrasing, and I’ve provided links to more thorough discussions of these issues, for example Beckstead’s dissertation. Maybe it would help if you explained what kind of reasoning you are using to identify which claims are “doing the crucial work”? Or we could just let it be.
Yeah, I’ve read Nick’s thesis, and I think the moral urgency of filling the universe with people is the more important basis of his conclusion than the rejection of time preference. The sentence suggests that the rejection of time preference is most important.
If I get him right, Nick agrees that the time issue is much less important than you suggested in your recent interview.
Sorry to insist! :) But when you disagree with Bostrom’s and Beckstead’s conclusions, people immediately assume that you must be valuing present people more than future ones. And I’m constantly like: “No! The crucial issue is whether the non-existence of people (where there could be some) poses a moral problem, i.e. whether it’s morally urgent to fill the universe with people. I doubt it.”
Okay, so we’re talking about two points: (1) whether current people have more value than future people, and (2) whether it would be super-good to create gazillions of super-good lives.
My sentence mentions both of those, in sequence: “Many EAs value future people roughly as much as currently-living people [1], and think that nearly all potential value is found in the well-being of the astronomical numbers of people who could populate the far future [2]...”
And you are suggesting… what? That I switch the order in which they appear, so that [2] appears before [1], and is thus emphasized? Or that I use your phrase “morally urgent to” instead of “nearly all potential value is found in...”? Or something else?
Sorry for the delay!
I forgot to clarify the rough argument for why (1) “value future people equally” is much less important or crucial than (2) “fill the universe with people” here.
If you accept (2), you’re almost guaranteed to be on board with where Bostrom and Beckstead are roughly going (even if you valued present people more!). It’s hardly possible to then block their argument on normative grounds, and criticism would have to be empirical, e.g. based on the claim that dystopian futures may be likelier than commonly assumed, which would decrease the value of x-risk reduction.
By contrast, if you accept (1), it’s still very much an open question whether you’ll be on board.
Also, intrinsic time preference is really not an issue among EAs. The idea that spatial and temporal distance are irrelevant when it comes to helping others is a pretty core element of the EA concept. What is an issue, though, is the question of what helping others actually means (or should mean). Who are the relevant others? Persons? Person-moments? Preferences? And how are they relevant? Should we ensure the non-existence of suffering? Or promote ecstasy too? Prevent the existence of unfulfilled preferences? Or create fulfilled ones too? Can you help someone by bringing them into existence? Or only by preventing their miserable existence/unfulfilled preferences? These issues are more controversial than the question of time preference. Unfortunately, they’re of astronomical significance.
I don’t really know if I’m suggesting any further specific change to the wording—sorry about that. It’s tricky… If you’re speaking to non-EAs, it’s important to emphasize the rejection of time preference. But there shouldn’t be a “therefore”, which (in my perception) is still implicitly there. And if you’re speaking to people who already reject time preference, it’s even more important to make it clear that this rejection doesn’t imply “fill the universe with people”. One solution could be to simply drop the reference to the (IMO non-decisive) rejection of time preference and go for something like: “Many EAs consider the creation of (happy) people valuable and morally urgent, and therefore think that nearly all potential value...”
Beckstead might object that the rejection of heavy time preference is important to his general conclusion (the overwhelming importance of shaping the far future). But if we’re talking that level of generality, then the reference to x-risk reduction should probably go or be qualified. For sufficiently negative-leaning EAs (such as Brian Tomasik) believe that x-risk reduction is net negative.
Perhaps the best solution would be to expand the section and start by mentioning how the (EA-uncontroversial) rejection of time preference is relevant to the overwhelming importance of shaping the far future. Once we’ve established that the far future likely dominates, the question arises how we should morally affect the far future. Depending on this question, very different conclusions can result e.g. with regard to the importance and even the sign of x-risk reduction.
I don’t want to expand the section, because that makes it stand out more than is compatible with my aims for the post. And since the post is aimed at non-EAs and new EAs, I don’t want to drop the point about time preference, as “intrinsic” time-discounting is a common view outside EA, especially for those with a background in economics rather than philosophy. So my preferred solution is to link to a fuller discussion of the issues, which I did (in particular, Beckstead’s thesis). Anyway, I appreciate your comments.