Thanks! I haven’t listened yet but I think the iterative natural kind approach is quite similar indeed.
Agreed that you’re going to need to make judgement calls one way or another. But these don’t have to be final! You can also run follow-up investigations to gather new information. This should make judgement calls easier (but maybe bring up some new ones). One nice thing with models (compared to humans) is that it’s much easier to run experiments on them. E.g. we can resample and we have access to activations. So i would argue iterative approaches are less bottlenecked by judgement calls.
Thanks! I haven’t listened yet but I think the iterative natural kind approach is quite similar indeed.
Agreed that you’re going to need to make judgement calls one way or another. But these don’t have to be final! You can also run follow-up investigations to gather new information. This should make judgement calls easier (but maybe bring up some new ones). One nice thing with models (compared to humans) is that it’s much easier to run experiments on them. E.g. we can resample and we have access to activations. So i would argue iterative approaches are less bottlenecked by judgement calls.