I’m a bit confused. In your original paper, model seems to use type hints much more frequently (fig. 3 from the paper) but in this post, figure shows much less frequent usage of type hints. Why?
Hi, Thank you for the question. In Figure 2 of the original paper (attached below), a two-step process was used to train the evaluation aware model organism. Our experiments used the model organism after training phase 1 and not 2, which is why there is the discrepancy you highlighted.
I’m a bit confused. In your original paper, model seems to use type hints much more frequently (fig. 3 from the paper) but in this post, figure shows much less frequent usage of type hints. Why?
Hi,
Thank you for the question. In Figure 2 of the original paper (attached below), a two-step process was used to train the evaluation aware model organism. Our experiments used the model organism after training phase 1 and not 2, which is why there is the discrepancy you highlighted.
Thank you!