I mean, how do we enforce the rate limits when every request comes from a different IP?
Edit: Ah, you mean, maybe a whole joint queue. Yeah, that’s not crazy, we were thinking of doing something that prioritizes requests by users who are not first-time users, for that reason. I am a bit scared of it because it possibly just pushes the problem under the rug in a way that has large costs, but removes any feedback we get about it (because anyone who would tell us the site is behaving badly for them is now in the prioritized category, but we are missing out on growth because new users often have a bad experience).
I mean, how do we enforce the rate limits when every request comes from a different IP?
Edit: Ah, you mean, maybe a whole joint queue. Yeah, that’s not crazy, we were thinking of doing something that prioritizes requests by users who are not first-time users, for that reason. I am a bit scared of it because it possibly just pushes the problem under the rug in a way that has large costs, but removes any feedback we get about it (because anyone who would tell us the site is behaving badly for them is now in the prioritized category, but we are missing out on growth because new users often have a bad experience).
Yeah, hurting new user experience is a risk for sure.
Maybe just switch over to the group queue system temporarily when a deluge hits?
Wouldn’t surprise me if this got more common over time, such that what is now a deluge will become the new baseline.