needs to be done interactively … people get stuck in a variety of different ways
I think the previous examples of large-scale risk I mentioned are a clear counterexample—if you have at least one part of the scenario clearly modeled, people have something concrete to latch on to.
You also link somewhere that talks about the nuclear discontinuity, and hints at an intelligence discontinuity—but I also went searching for evidence of a discontinuity in cognition and didn’t find one. You would expect cognitive scientists to have found this by now.
Hard to find ‘counter references’ for a lack of something, this is the best I can do:
“Thus, standard (3rd-person) investigations of this process leave open the ancient question as to whether specific upgrades to cognition induce truly discontinuous jumps in consciousness. The TAME framework is not incompatible with novel discoveries about sharp phase transitions, but it takes the null hypothesis to be continuity, and it remains to be seen whether contrary evidence for truly sharp upgrades in consciousness can be provided.” TAME, Levin
Do you have a post regarding your decision calculus re the foom exfohazard?
Because it seems to me the yolo-brigade are a lot better at thinking up foom mechanisms than the folks in DC. So by holding information back you are just keeping it from people who might actually need it (politicians, who can’t think of it for themselves), while making no difference to people who might use it (who can come up with plenty of capabilities themselves).
But maybe you have gone over this line of reasoning somewhere..
I think the previous examples of large-scale risk I mentioned are a clear counterexample—if you have at least one part of the scenario clearly modeled, people have something concrete to latch on to.
You also link somewhere that talks about the nuclear discontinuity, and hints at an intelligence discontinuity—but I also went searching for evidence of a discontinuity in cognition and didn’t find one. You would expect cognitive scientists to have found this by now.
Hard to find ‘counter references’ for a lack of something, this is the best I can do:
Do you have a post regarding your decision calculus re the foom exfohazard?
Because it seems to me the yolo-brigade are a lot better at thinking up foom mechanisms than the folks in DC. So by holding information back you are just keeping it from people who might actually need it (politicians, who can’t think of it for themselves), while making no difference to people who might use it (who can come up with plenty of capabilities themselves).
But maybe you have gone over this line of reasoning somewhere..