Thanks! That’s an important comment. This report represents work in progress, and we will definetely take your words into account, Claude’s opinion on whether it’s being evaluated doesn’t necessarily changes linearly with the amount with “eval” properties.
Good luck with your follow-up experiments, this is important work! I should also say that my impression was formed based on experiments in a couple of specific environments, so take it as one data point rather than as conclusive evidence.
Thanks! That’s an important comment. This report represents work in progress, and we will definetely take your words into account, Claude’s opinion on whether it’s being evaluated doesn’t necessarily changes linearly with the amount with “eval” properties.
Good luck with your follow-up experiments, this is important work! I should also say that my impression was formed based on experiments in a couple of specific environments, so take it as one data point rather than as conclusive evidence.