I’m not sure how much we are disagreeing here. I’m not proposing anything like formal verification. I think development in simulation is likely to be an important tool in getting it right the first time you go “live”, but I also think there may be other useful general techniques/tools, and that it could be worth investigating them well in advance of need.
Agreed. In particular I think IRL (Inverse Reinforcement Learning) is likely to turn out to be very important. Also, it is likely that the brain has some clever mechanisms for things like value acquisition or IRL, as well as empathy/altruism, and figuring out those mechanisms could be useful.
I’m not sure how much we are disagreeing here. I’m not proposing anything like formal verification. I think development in simulation is likely to be an important tool in getting it right the first time you go “live”, but I also think there may be other useful general techniques/tools, and that it could be worth investigating them well in advance of need.
Agreed. In particular I think IRL (Inverse Reinforcement Learning) is likely to turn out to be very important. Also, it is likely that the brain has some clever mechanisms for things like value acquisition or IRL, as well as empathy/altruism, and figuring out those mechanisms could be useful.