Very interesting and super pleasant to read! One thing I think that’s kinda missing but would be interesting to see here is the difference between placing the same content/​instructions in <system> vs. <user> prompts and how that affects generation etc. and how does this vary between the actual content of the text i.e. do certain kinds of content cause more variation when we switch the placement as compared to others?
Very interesting and super pleasant to read!
One thing I think that’s kinda missing but would be interesting to see here is the difference between placing the same content/​instructions in <system> vs. <user> prompts and how that affects generation etc. and how does this vary between the actual content of the text i.e. do certain kinds of content cause more variation when we switch the placement as compared to others?