I’m hesitant to share the work test completely publicly because it risks getting goodharted. I.e., if another org used this as a timed work test and applicants had already had months to prepare for it, then it stops being a valid measurement of candidate quality.
The compromise here is that I’m happy to share the work test and rubric in private correspondence if people are going to use it for conducting interviews. But I can also describe the broad strokes of what it entailed. Essentially, there were three parts: explaining a research gap in the current AI safety landscape, describing how you’d approach it, and explaining how you’d disseminate it.
I’ll happily read that DM and won’t forward what you share (but will likely display or talk about it).
I’d like to be able to say to someone who wants to work in safety ‘here is an example of a practical problem and the way it is graded, if your thinking is aligned this way, you might have a future in the field’.
Note: I selfishly want to see exactly how far that I am from aligned (it’s a lot).
Please post the work test and grading template you used. A lot of people here might benefit from reading it.
I’m hesitant to share the work test completely publicly because it risks getting goodharted. I.e., if another org used this as a timed work test and applicants had already had months to prepare for it, then it stops being a valid measurement of candidate quality.
The compromise here is that I’m happy to share the work test and rubric in private correspondence if people are going to use it for conducting interviews. But I can also describe the broad strokes of what it entailed. Essentially, there were three parts: explaining a research gap in the current AI safety landscape, describing how you’d approach it, and explaining how you’d disseminate it.
I’ll happily read that DM and won’t forward what you share (but will likely display or talk about it).
I’d like to be able to say to someone who wants to work in safety ‘here is an example of a practical problem and the way it is graded, if your thinking is aligned this way, you might have a future in the field’.
Note: I selfishly want to see exactly how far that I am from aligned (it’s a lot).
I would love to rry the work test also!