Fair enough, I agree with this. Using a website like Prolific.com definitely selects for lower income bracket, because I only paid 0.13 GBP per response.
I used representative sample based on US census so you get people across both sexes and all age groups and ethnicities.
Beyond this I don’t have deep understanding of who uses the website. You can check their subreddits for more on who Prolific gets marketed to, as a source of income.
Yeah this is the first not last question you need to ask. Remember the replication crisis? They were aware of this decades before they hit that problem.
Any data is good data, but only if you know where it came from.
Your analysis leaves out the most critical factor: What sort of person is likely to take this study?
That is, how is this study publicized and inventivised?
We cannot interpret these results at all without knowing something about the selection effects.
Fair enough, I agree with this. Using a website like Prolific.com definitely selects for lower income bracket, because I only paid 0.13 GBP per response.
I used representative sample based on US census so you get people across both sexes and all age groups and ethnicities.
Beyond this I don’t have deep understanding of who uses the website. You can check their subreddits for more on who Prolific gets marketed to, as a source of income.
Yeah this is the first not last question you need to ask. Remember the replication crisis? They were aware of this decades before they hit that problem.
Any data is good data, but only if you know where it came from.
Keep getting data, just include the context!