The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers
[ABSTRACT READ IN FULL AT SOURCE, at the journal's own article page hosted at dlab.sauder.ubc.ca] Stewart, N., Ungemach, C., Harris, A. J. L., Bartels, D. M., Newell, B. R., Paolacci, G., & Chandler, J. (2015). 'The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers.' Judgment and Decision Making, 10(5), 479-491. THE SINGLE BEST FIGURE ON THE MODERN POOL, IN THEIR WORDS: 'Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.' Put beside a large undergraduate subject pool the comparison is not flattering: a few thousand people, mostly in one country, shared with hundreds of laboratories, half of them replaced every seven months.
[ABSTRACT READ IN FULL AT SOURCE, at the journal's own article page hosted at dlab.sauder.ubc.ca] Stewart, N., Ungemach, C., Harris, A. J. L., Bartels, D. M., Newell, B. R., Paolacci, G., & Chandler, J. (2015). 'The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers.' Judgment and Decision Making, 10(5), 479-491. THE SINGLE BEST FIGURE ON THE MODERN POOL, IN THEIR WORDS: 'Using capture-recapture analysis we estimate the effective size of the active Amazon Mechanical Turk (MTurk) population that a typical laboratory can access to be about 7,300 workers. We also estimate that the time taken for half of the workers to leave the MTurk pool and be replaced is about 7 months. Each laboratory has its own population pool which overlaps, often extensively, with the hundreds of other laboratories using MTurk. Our estimate is based on a sample of 114,460 completed sessions from 33,408 unique participants and 689 sessions across seven laboratories in the US, Europe, and Australia from January 2012 to March 2015.' Put beside a large undergraduate subject pool the comparison is not flattering: a few thousand people, mostly in one country, shared with hundreds of laboratories, half of them replaced every seven months.
Written from the aBSTRACT READ IN FULL AT SOURCE, at the journal's own article page hosted at dlab.sauder.ubc.ca.
What our sources record
Recorded when this source was checked, figures included, with page references and quotation marks removed.
Stewart, N., Ungemach, C., Harris, A. J. L., Bartels, D. M., Newell, B. R., Paolacci, G., & Chandler, J. (2015). The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers. Judgment and Decision Making, 10(5), 479-491