“Overall, access to the AI strongly improved the subjects’ accuracy from below 50% to around 70%, which was further boosted to a value slightly below the AI’s accuracy of 75% when users also saw explanations. “
But this seems to be a function of the AI system’s actual performance, the human’s expectations of said performance, as well as the human’s baseline performance. So I’d expect it to vary a lot between tasks and with different systems.
“Overall, access to the AI strongly improved the subjects’ accuracy from below 50% to around 70%, which was further boosted to a value slightly below the AI’s accuracy of 75% when users also saw explanations. “
But this seems to be a function of the AI system’s actual performance, the human’s expectations of said performance, as well as the human’s baseline performance. So I’d expect it to vary a lot between tasks and with different systems.