I’ve read so many posts highlighting the dangers of AGI that I often feel terribly anxious about it. I’m pretty young, and the idea that there’s a possible utopia waiting for us that seems to be slipping through our fingers kills me. But even more than that, I worry that I won’t have the chance to enjoy much of my life. That the work I’ve put in now won’t amount to much, and that the relationships I’ve cultivated will never really get the chance to grow for the decades that should be every human’s right.
Even just earlier today, I was reading an article when my cat came up to me and started rolling around next to my leg, purring and playing with me. She’s pretty old- certainly not young enough for any chance at biological immortality. I was struck by the sense that I should put down my laptop and play with her, because the finite life she has here deserves to be filled with joy and love. That even if there’s no chance for her to live forever, that what she has should and has been made better by me. A long, full life of satisfaction is enough for her.
I don’t necessarily mind on missing out on utopia. I’d obviously like it to happen, but its inconceivable to me. So if a billion years of technologically-enhanced superhumanity isn’t in the cards for me? I’ll be okay.
But there’s no one there to make sure that I get the full allotment of life that I’ve got left. I feel overwhelmed by the sense that in a few decades from now, if this problem isn’t solved, the flame of my life will be snuffed out by a system I don’t understand and could never defeat. I’ll never have that long-term marriage, that professional career, or the chance to finally achieve the expert level in my hobbies. I’ll just be gone, along with everything else that could possibly matter to me.
If I can’t have immortality, I at least want a long, peaceful life. But the threat of AGI robs me of even that possibility, if its as certain a disaster as I’ve come to believe.
Buck up; it’s not a certain disaster. I think if you even averaged predictions from serious alignment researchers you’d get in the neighborhood of a 50% chance at survival and a really good (ultra-utopian or something) outcome.
It makes no sense to worry about something you can’t control. That doesn’t make the anxiety go away, but it can be the rationale that gets you to do the work to feel more relaxed. Gratitude is an empirically demonstrated route to more happiness. I feel grateful every day that I live in a warm house with good food, with little struggle for status or survival. The vast majority of humanity has not been so lucky. Taking that perspective was effortful when I started, but has become automatic through practice.
I’ve seen this attitude echoed by many LW users and I went through a similar phase myself. If you value learning and discovery life will never be truly ‘peaceful’ as you’ll still find sources of anxiety and existential dread, other aspects of your life like long-term marriage and career should not be affected.
If disaster is certain your options are 1. Seek shelter or 2. Sit back and enjoy the view of the rising mushroom cloud. If disaster is not certain you have many options. Either way you should still make long term plans and seek meaningful life experiences. It is fear that robs you, not the threat of AGI. Do not give up on seeking fulfilment because of what might happen a few decades from now.
And don’t worry about your cat, she’s happy when her human is happy ;-)
I’ve read so many posts highlighting the dangers of AGI that I often feel terribly anxious about it. I’m pretty young, and the idea that there’s a possible utopia waiting for us that seems to be slipping through our fingers kills me. But even more than that, I worry that I won’t have the chance to enjoy much of my life. That the work I’ve put in now won’t amount to much, and that the relationships I’ve cultivated will never really get the chance to grow for the decades that should be every human’s right.
Even just earlier today, I was reading an article when my cat came up to me and started rolling around next to my leg, purring and playing with me. She’s pretty old- certainly not young enough for any chance at biological immortality. I was struck by the sense that I should put down my laptop and play with her, because the finite life she has here deserves to be filled with joy and love. That even if there’s no chance for her to live forever, that what she has should and has been made better by me. A long, full life of satisfaction is enough for her.
I don’t necessarily mind on missing out on utopia. I’d obviously like it to happen, but its inconceivable to me. So if a billion years of technologically-enhanced superhumanity isn’t in the cards for me? I’ll be okay.
But there’s no one there to make sure that I get the full allotment of life that I’ve got left. I feel overwhelmed by the sense that in a few decades from now, if this problem isn’t solved, the flame of my life will be snuffed out by a system I don’t understand and could never defeat. I’ll never have that long-term marriage, that professional career, or the chance to finally achieve the expert level in my hobbies. I’ll just be gone, along with everything else that could possibly matter to me.
If I can’t have immortality, I at least want a long, peaceful life. But the threat of AGI robs me of even that possibility, if its as certain a disaster as I’ve come to believe.
Buck up; it’s not a certain disaster. I think if you even averaged predictions from serious alignment researchers you’d get in the neighborhood of a 50% chance at survival and a really good (ultra-utopian or something) outcome.
It makes no sense to worry about something you can’t control. That doesn’t make the anxiety go away, but it can be the rationale that gets you to do the work to feel more relaxed. Gratitude is an empirically demonstrated route to more happiness. I feel grateful every day that I live in a warm house with good food, with little struggle for status or survival. The vast majority of humanity has not been so lucky. Taking that perspective was effortful when I started, but has become automatic through practice.
I’ve seen this attitude echoed by many LW users and I went through a similar phase myself. If you value learning and discovery life will never be truly ‘peaceful’ as you’ll still find sources of anxiety and existential dread, other aspects of your life like long-term marriage and career should not be affected.
If disaster is certain your options are 1. Seek shelter or 2. Sit back and enjoy the view of the rising mushroom cloud. If disaster is not certain you have many options. Either way you should still make long term plans and seek meaningful life experiences. It is fear that robs you, not the threat of AGI. Do not give up on seeking fulfilment because of what might happen a few decades from now.
And don’t worry about your cat, she’s happy when her human is happy ;-)
Not everyone, even on LW is so pessimistic and LW is more pessimistic than the views from experts in the field in general I feel. For example here