Ah! So you’re imagining the reporter not as a module that knows how to interpret the signals in a given predictor, but instead as a meta-learning system that figures out whatever predictor happens to be in front of it. Is that right? That seems like a much harder sort of model to build...
I think some generality is necessary, otherwise we’d have to retrain the reporter every time the predictor is updated. That would rule out a lot of desirable uses for a reporter, like using its output in the training process.
Ah! So you’re imagining the reporter not as a module that knows how to interpret the signals in a given predictor, but instead as a meta-learning system that figures out whatever predictor happens to be in front of it. Is that right? That seems like a much harder sort of model to build...
I think some generality is necessary, otherwise we’d have to retrain the reporter every time the predictor is updated. That would rule out a lot of desirable uses for a reporter, like using its output in the training process.