Author of the Conduit blog post here. I won’t comment on the substance of this post (for now, anyways), but did want to say two meta-level points:
As usual, LessWrong provides by far the most thoughtful critique I’ve seen. The comments are also great. In the spirit of Cunningham’s Law, I’m glad my blog post provoked this piece!
I really appreciate OP for emailing me before publishing this post. I asked for a call and heard his threat models beyond what is written here, which were interesting.
I think that’s a fine critique, but I think it’s good to give people a bunch of time. I do think it’s better to indicate you saw something and appreciated it. I think it puts you more on the hook of engaging with it. Serious engagement can follow later on, and of course often takes a while. Some people can shoot off well-formed responses immediately in comments, but most want to take some time to think about how to respond.
My first time hearing about the potential for smarter-than-human AI was when I was 12, but for years I figured it was just a weird but interesting idea that people on the internet liked to write about.
By “people on the internet” I entirely meant the people of lesswrong.com, of course.)
Author of the Conduit blog post here. I won’t comment on the substance of this post (for now, anyways), but did want to say two meta-level points:
As usual, LessWrong provides by far the most thoughtful critique I’ve seen. The comments are also great. In the spirit of Cunningham’s Law, I’m glad my blog post provoked this piece!
I really appreciate OP for emailing me before publishing this post. I asked for a call and heard his threat models beyond what is written here, which were interesting.
I really dislike this ‘I don’t say anything on the strong moral critiques against my actions, but signal how nice a person I am’ approach.
I think that’s a fine critique, but I think it’s good to give people a bunch of time. I do think it’s better to indicate you saw something and appreciated it. I think it puts you more on the hook of engaging with it. Serious engagement can follow later on, and of course often takes a while. Some people can shoot off well-formed responses immediately in comments, but most want to take some time to think about how to respond.
(Tangentially, in my blog post I write:
By “people on the internet” I entirely meant the people of lesswrong.com, of course.)