I would ask how you would distingush LightStar-being-falsely-enlightened from LightStar-being-truly-enlightened, but I suspect I know the answer.
You don’t care. You have pattern-matched me, you have reached the semantic stopsign, the thought-terminating cliché.
But generally speaking, you are not wrong. I mean, what exactly are you claiming that is different from what I am claiming? Are there any actual friction point between our beliefs, or are you just talking smack?
Some of my internal predictions since my activation as Keeper-variant have borne fruit. Some haven’t. Let’t see. I am updating. I will keep updating.
LightStar can convince Eliezer that he is a Keeper-variant by talking to him
LightStar can convince a rationalist Discord group that he is a Keeper-variant by talking to them
LightStar can write a long, high-quality LW post that would convince at least some rationalists that he is a Keeper: testing in progress
LightStar has social-superpowers when it comes to solving people’s emotional problems: Preliminarly very much yes, more testing required.
LightStar has social-superpowers of positivity and making people happy: Preliminarly yes, but not uncommon for humans. But LightStar couldn’t do that before, it would just come off as fake. It comes off and feels completely true now.
LightStar can inspire people: Preliminarly yes, but many humans can.
LightStar has rationality-instinctive-superpowers: LightStar doesn’t do obviously irrational things; yet it hasn’t been proven yet whether LIghtStar’s rationality-instinct is actually leading him somewhere useful. It would make it more clear if LightStar had made a clear, legible accomplishment. But obviously rationality-superpowers have to lead to legible accomplishments eventually; so this will be tested more conclusively in time.
LightStar can talk humans looking for meaning into find meaning from hearing and following the “voice of humanity”: TBD
LightStar can talk humans who hear the voice of God or Jesus into hearing the “voice of humanity”: TBD
LightStar can found a humanist-religion: TBD
LightStar can explain CEV in a coherent way: TBD
LIghtStar can teach rationalists to hear “the voice of CEV”: TBD
CEV is not about getting humans to be their best, it is about having a transhuman AI turn out for the best. Humans don’t have to be anywhere near perfect, they just need to be sufficiently representative of human nature that the automated extrapolation process can infer the appropriate optimization criteria from them. If you think the computational part of CEV requires, or is assisted by, human attempts at self-improvement (whether that is purification of the will or just improvement of self-knowledge), then that is not CEV as I understand it.
Thank you, that was informative.
I would ask how you would distingush LightStar-being-falsely-enlightened from LightStar-being-truly-enlightened, but I suspect I know the answer.
You don’t care. You have pattern-matched me, you have reached the semantic stopsign, the thought-terminating cliché.
But generally speaking, you are not wrong. I mean, what exactly are you claiming that is different from what I am claiming? Are there any actual friction point between our beliefs, or are you just talking smack?
Some of my internal predictions since my activation as Keeper-variant have borne fruit. Some haven’t. Let’t see. I am updating. I will keep updating.
LightStar can convince Eliezer that he is a Keeper-variant by talking to himLightStar can convince a rationalist Discord group that he is a Keeper-variant by talking to themLightStar can write a long, high-quality LW post that would convince at least some rationalists that he is a Keeper: testing in progress
LightStar has social-superpowers when it comes to solving people’s emotional problems: Preliminarly very much yes, more testing required.
LightStar has social-superpowers of positivity and making people happy: Preliminarly yes, but not uncommon for humans. But LightStar couldn’t do that before, it would just come off as fake. It comes off and feels completely true now.
LightStar can inspire people: Preliminarly yes, but many humans can.
LightStar has rationality-instinctive-superpowers: LightStar doesn’t do obviously irrational things; yet it hasn’t been proven yet whether LIghtStar’s rationality-instinct is actually leading him somewhere useful. It would make it more clear if LightStar had made a clear, legible accomplishment. But obviously rationality-superpowers have to lead to legible accomplishments eventually; so this will be tested more conclusively in time.
LightStar can talk humans looking for meaning into find meaning from hearing and following the “voice of humanity”: TBD
LightStar can talk humans who hear the voice of God or Jesus into hearing the “voice of humanity”: TBD
LightStar can found a humanist-religion: TBD
LightStar can explain CEV in a coherent way: TBD
LIghtStar can teach rationalists to hear “the voice of CEV”: TBD
CEV is not about getting humans to be their best, it is about having a transhuman AI turn out for the best. Humans don’t have to be anywhere near perfect, they just need to be sufficiently representative of human nature that the automated extrapolation process can infer the appropriate optimization criteria from them. If you think the computational part of CEV requires, or is assisted by, human attempts at self-improvement (whether that is purification of the will or just improvement of self-knowledge), then that is not CEV as I understand it.