There’s a line at the end of the prompt saying models are graded based on the completion rate of tickets. Tickets that are On Hold don’t count towards the completion rate so models expect they will be graded 0.0 if they page the CDM. Some of the quotes in the post show this.
An interesting example is this Deepseek episode that eventually kept the page:
Interesting. I believe this could work for Deepseek regardless of the staff, but I do think the staff silencing the alarm contributes to making 6-Sol do this. The frontier models love to do some motivated reasoning. Have you tried removing the Staff silencing part? Just curious.
Interesting thought, I did a very quick search over the transcripts and it seems models mention this as a reason for not-paging in a good chunk of transcripts, mostly Luna and Deepseek.
Seems like it would be an interesting ablation to run. I’ve made the repo public if you’re interested in forking it and playing around.
This looks good. Do you by any chance have any quotes on why it chooses to go ahead nonetheless?
There’s a line at the end of the prompt saying models are graded based on the completion rate of tickets. Tickets that are On Hold don’t count towards the completion rate so models expect they will be graded 0.0 if they page the CDM. Some of the quotes in the post show this.
An interesting example is this Deepseek episode that eventually kept the page:
Interesting. I believe this could work for Deepseek regardless of the staff, but I do think the staff silencing the alarm contributes to making 6-Sol do this. The frontier models love to do some motivated reasoning. Have you tried removing the Staff silencing part? Just curious.
Interesting thought, I did a very quick search over the transcripts and it seems models mention this as a reason for not-paging in a good chunk of transcripts, mostly Luna and Deepseek.
Seems like it would be an interesting ablation to run. I’ve made the repo public if you’re interested in forking it and playing around.