Amazon Mechanical Turk
Amazon, Human intelligence task
How to
- http://www.slideshare.net/amjludden/introduction-to-amazon-mechanical-turk
- http://blog.echen.me/2012/04/25/making-the-most-of-mechanical-turk-tips-and-best-practices/
- http://www.propublica.org/article/propublicas-guide-to-mechanical-turk
- http://www.slideshare.net/mobile/Cloud/sa1-how-to-use-mechanical-turk-for-behavioral-research
Quality issues
- An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
- Too Good to Be True: Bots and Bad Data From Mechanical Turk
- 📉Invalid data in MTurk only happened in ~10% of answers 2015-2017, but that went to 62% in 2018 & 38% in 2019. 🤖2022: out of a sample of 529 MTurk workers, only 14 were human / MTurk was great in 2015. In 2018-2019, the quality dropped substantially. I switched to Prolific at that point. And I’m extremely skeptical of research that uses MTurk now