This sounds interesting! Is this some sort of optimization problem between the 2 goals?
Is this like having 2 utility functions? But can’t you only have a single utility function? Or you need to somehow fit both utility functions into a single utility function?
I feel like hard optimization problems might be very useful for preventing catastrophic outcomes, because then the agent can’t maximize its only goal too aggressively. It needs to act more carefully. I have another idea for a very hard optimization problem in mind, and this has to do with decision-making under uncertainty of stronger things existing. I can tell more if you like.
This sounds interesting! Is this some sort of optimization problem between the 2 goals?
Is this like having 2 utility functions? But can’t you only have a single utility function? Or you need to somehow fit both utility functions into a single utility function?
I feel like hard optimization problems might be very useful for preventing catastrophic outcomes, because then the agent can’t maximize its only goal too aggressively. It needs to act more carefully. I have another idea for a very hard optimization problem in mind, and this has to do with decision-making under uncertainty of stronger things existing. I can tell more if you like.