If you go to Yudkowski and say “Hey, I want to build an AGI, can you please tell me how to do so safely?”, he will answer “I can’t tell you how to build an AGI safely. If you are going to successfully build an AGI you are likely to kill us all. Don’t build an AGI”.
Yudkoswky is self-aware that he doesn’t have the expertise that would be necessary to build a safe AGI. If you then search for an expert who gives you some advice about how to build your AGI and you succeed in building your AGI and kill everyone, that was a trap of your own making.
If you want a past example, David Chapman´s article about Domestic Science is great. More recently, you had a flatlining of childhood obesity rates in the second Bush administration. Afterwards, Michelle Obama started a huge program to improve childhood nutrition through various measures recommended by nutrition scientists. After those programs childhood obesity rates were rising again.
Scientists studying nutrition do believe themselves to be experts, but seem to give advice that produces more problems than it solves.
Reality doesn´t just reward you for having put in a lot of effort.
If you go to Yudkowski and say “Hey, I want to build an AGI, can you please tell me how to do so safely?”, he will answer “I can’t tell you how to build an AGI safely. If you are going to successfully build an AGI you are likely to kill us all. Don’t build an AGI”.
Yudkoswky is self-aware that he doesn’t have the expertise that would be necessary to build a safe AGI. If you then search for an expert who gives you some advice about how to build your AGI and you succeed in building your AGI and kill everyone, that was a trap of your own making.
If you want a past example, David Chapman´s article about Domestic Science is great. More recently, you had a flatlining of childhood obesity rates in the second Bush administration. Afterwards, Michelle Obama started a huge program to improve childhood nutrition through various measures recommended by nutrition scientists. After those programs childhood obesity rates were rising again.
Scientists studying nutrition do believe themselves to be experts, but seem to give advice that produces more problems than it solves.
Reality doesn´t just reward you for having put in a lot of effort.