(Not 100% sure I understood your comment.) Training is one idea, but you could also just test out heuristics with this framework. For example, I think this scheme could be used to benchmark quantilization against a competing approach.
Pretty sure you understood it :) But yeah, not only would I like to be able to compare two things, I’d like to be able to find the optimum values of some continuous variables. Though I suppose it doesn’t matter as much if you’re trying to check / evaluate ideas that you arrived at by more abstract reasoning.
(Not 100% sure I understood your comment.) Training is one idea, but you could also just test out heuristics with this framework. For example, I think this scheme could be used to benchmark quantilization against a competing approach.
Pretty sure you understood it :) But yeah, not only would I like to be able to compare two things, I’d like to be able to find the optimum values of some continuous variables. Though I suppose it doesn’t matter as much if you’re trying to check / evaluate ideas that you arrived at by more abstract reasoning.