It varies between cultures a lot. When I check reviews of stories I have written on Amazon or Goodreads I always calibrate by clicking on the user portrait and seeing what they normally give. Many of my 5-star ratings are not much to celebrate: turns out they have given 5 to everything ever. But it makes me smile when I see that my 4-star was the highest rating that person gave in the last 10-20 things they reviewed.
I assume that Uber and similar software already does this automatically under the hood. They know a 4-star rating from a prolific 5-star giver is a bad sign. They know a 4-star is good from that person who aims to give 3 on average because “that’s obviously what a well-calibrated person does”. I think the searching algorithms at least know this.
It varies between cultures a lot. When I check reviews of stories I have written on Amazon or Goodreads I always calibrate by clicking on the user portrait and seeing what they normally give. Many of my 5-star ratings are not much to celebrate: turns out they have given 5 to everything ever. But it makes me smile when I see that my 4-star was the highest rating that person gave in the last 10-20 things they reviewed.
I assume that Uber and similar software already does this automatically under the hood. They know a 4-star rating from a prolific 5-star giver is a bad sign. They know a 4-star is good from that person who aims to give 3 on average because “that’s obviously what a well-calibrated person does”. I think the searching algorithms at least know this.