I think I already want to back off on my assertion that the categories should not be applied to controllers. However, I see the application to controllers as more complex. It’s more clear what it means to (successfully) point a selection-style optimization process at a proxy. In a selection setting, you have the proxy (which the system can access), and the true value (which is not accessible). Wireheading only makes sense when “true” is partially accessible, and the agent severs that connection.
I definitely appreciate your posts on this; it hadn’t occurred to me to ask whether the four types apply equally well to selection and control.
I think I already want to back off on my assertion that the categories should not be applied to controllers. However, I see the application to controllers as more complex. It’s more clear what it means to (successfully) point a selection-style optimization process at a proxy. In a selection setting, you have the proxy (which the system can access), and the true value (which is not accessible). Wireheading only makes sense when “true” is partially accessible, and the agent severs that connection.
I definitely appreciate your posts on this; it hadn’t occurred to me to ask whether the four types apply equally well to selection and control.