Even though I don’t think MTurk could be used for veg flyers very well, it’s the best example I can think of right now: imagine that the current flyer converts 1% of people who read it to consider vegetarianism, but a different flyer might convert 1.05% of people. This means that every donation to veg ads now has approximately a 1.05x multiplier attached to it, because we can use the better flyer. If the MTurk study/studies to find this cost $1K, we would break even on this after distributing 100K flyers at 20 cents a flyer.
This completely discounts the value of convincing people on Mechanical Turk to switch to vegetarianism.
If a flyer can convert 1% of the people who read the flyer maybe a well designed survey that get’s the participant to interact with it can convert more people.
If it costs 0.25$ to get a survey completed and 0.20$ to get a flyer delievered I would expect that survey to be better value for the money.
This completely discounts the value of convincing people on Mechanical Turk to switch to vegetarianism.
I had considered that, but it would be really difficult to tell whether you’ve convinced the actual MTurkers, so it would be hard to tell.
You’d probably have to either (1) do the identical study in a different realm where you can make it a surprise longitudinal study and attempt to re-contact people in a few months or (2) figure out a way to surprise re-contact the MTurkers.
But yeah, perhaps that ought to factor into the value consideration.
I had considered that, but it would be really difficult to tell whether you’ve convinced the actual MTurkers, so it would be hard to tell.
If you don’t think you can know whether you convinced the actual MTurkers, how are you going to use the data from them to know which flyers are effective?
This completely discounts the value of convincing people on Mechanical Turk to switch to vegetarianism.
If a flyer can convert 1% of the people who read the flyer maybe a well designed survey that get’s the participant to interact with it can convert more people.
If it costs 0.25$ to get a survey completed and 0.20$ to get a flyer delievered I would expect that survey to be better value for the money.
I had considered that, but it would be really difficult to tell whether you’ve convinced the actual MTurkers, so it would be hard to tell.
You’d probably have to either (1) do the identical study in a different realm where you can make it a surprise longitudinal study and attempt to re-contact people in a few months or (2) figure out a way to surprise re-contact the MTurkers.
But yeah, perhaps that ought to factor into the value consideration.
Edit: Apparently it is possible, though difficult, to run a longitudinal study on MTurk.
If you don’t think you can know whether you convinced the actual MTurkers, how are you going to use the data from them to know which flyers are effective?
Further tests of the changes in the field with longitudinal surveys.