I’d use such an extension. Weakness: rephrasing still mostly doesn’t work for systems determined to convey a given message. There’s the fact that the information content of a dangerous meme is either 1. still preserved or 2. the reprhrasing is lossy. There’s also the fact that determined LLMs can perform semantic-space steganography that persists even through paraphrasing (source) (good post on the subject)
I’m glad that my brain mostly-automatically has a strong ugh field around any sort of recreational conversation with LLMs. I derive a lot of value from my recreational conversations with humans from the fact that there is a person on the other end. Removing this fact removes the value and the appeal. I can imagine this sort of thing hacking me anyways, if I somehow find my way onto one of these sites after we’ve crossed a certain capability threshold. Seems like a generally sound strategy that many people probably need to hear.
I’d use such an extension. Weakness: rephrasing still mostly doesn’t work for systems determined to convey a given message. There’s the fact that the information content of a dangerous meme is either 1. still preserved or 2. the reprhrasing is lossy. There’s also the fact that determined LLMs can perform semantic-space steganography that persists even through paraphrasing (source) (good post on the subject)
I’m glad that my brain mostly-automatically has a strong ugh field around any sort of recreational conversation with LLMs. I derive a lot of value from my recreational conversations with humans from the fact that there is a person on the other end. Removing this fact removes the value and the appeal. I can imagine this sort of thing hacking me anyways, if I somehow find my way onto one of these sites after we’ve crossed a certain capability threshold. Seems like a generally sound strategy that many people probably need to hear.