You can also get them to output the EOS token, cutting off the response entirely while still in COT mode. I think I can use this as an injection attack vector, given their tendency to repeat parts of prompts in their COT.
You can also get them to output the EOS token, cutting off the response entirely while still in COT mode. I think I can use this as an injection attack vector, given their tendency to repeat parts of prompts in their COT.