Yep. It already happens with airliners, where pilots do errors specifically because they are too used to automation and fall prey to boredom induced sleepiness.
If there are sufficiently few special case, we could have the car stopping before it switches to manual mode. The goal being that the human would take control at leisure, and not in the midst of motion.
Or, switch to a semi manual mode, where safeties are still on. Even when lost, the car can still see nearby obstacles, sense weather the tires stick to the road etc.
We could also keep a fully manual (and unsafe!) mode, which is activated only by a pull on a lever followed by a push on a red button beneath the lever. Hopefully that should eliminate most “context switching” errors. (And the human could be blamed, and the car insurance may not activate etc… making you think thrice before you actually switch).
Yep. It already happens with airliners, where pilots do errors specifically because they are too used to automation and fall prey to boredom induced sleepiness.
If there are sufficiently few special case, we could have the car stopping before it switches to manual mode. The goal being that the human would take control at leisure, and not in the midst of motion.
Or, switch to a semi manual mode, where safeties are still on. Even when lost, the car can still see nearby obstacles, sense weather the tires stick to the road etc.
We could also keep a fully manual (and unsafe!) mode, which is activated only by a pull on a lever followed by a push on a red button beneath the lever. Hopefully that should eliminate most “context switching” errors. (And the human could be blamed, and the car insurance may not activate etc… making you think thrice before you actually switch).