ویراساینس.
سند علمی

Towards a Guideline for Conducting Economic Experiments on Amazon’s Mechanical Turk

Tim Straub, Florian Hawlitschek, Christof Weinhardt

چکیده

During the last decade Amazon Mechanical Turk has evolved to an established platform for conducting behavioral research. However, designing and conducting economic experiments on online labor markets remains a complex and ambitious task. In comparison to laboratory environments, a set of specific challenges (such as synchronization and control) has to be thoroughly addressed. In order to support researchers in fulfilling this task, we provide a framework of a continuously updating guideline for conducting economic experiments on Amazon’s Mechanical Turk. Our main contributions are the proposition of (i) a challenge-oriented view based on common experimental economics practices, and (ii) a collaborative continuous guideline approach.

اسناد مشابه

  • Evaluating Crowdsourcing through Amazon Mechanical Turk as a Technique for Conducting Music Perception Experiments

    سند علمی۲۰۱۲Jieun Oh, Ge Wang

    Online crowdsourcing marketplaces, such as the Amazon Mechanical Turk, provide an environment for cost-effective crowdsourcing on a massive scale, leveraging human intelligence, expertise, and judgment. While the Mechanical Turk is typically used by businesses to clean data, cate

  • Conducting Longitudinal Experiments with Behavioral Models in Repeated Stackelberg Security Games on Amazon Mechanical Turk

    سند علمی۲۰۱۵Debarun Kar, Fei Fang, Francesco Delle Fave, Nicole Sintov

    Recently, there has been an increase of interest in domains involving repeated interactions between defenders and adversaries. This has been modeled as a repeated Stackelberg Security Game (repeated SSG). Although different behavioral models have been proposed for the attackers i

  • Online Experiments using jsPsych, psiTurk, and Amazon Mechanical Turk

    سند علمی۲۰۱۴CogSciJosh de Leeuw, Anna Coenen, Douglas Markant, Jay B. Martin

    This half-day tutorial will cover how to build and deploy online experiments using jsPsych, psiTurk, and Amazon Mechanical Turk (AMT). jsPsych is an open-source JavaScript library that facilitates building behavioral experiments in a web browser. psiTurk is an open-source Python

  • Running experiments on Amazon Mechanical Turk

    سند علمی۲۰۱۰Gabriele Paolacci, Jesse Chandler, Woodrow Wilson, Panagiotis G. Ipeirotis

    Although Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited from online labor markets. We address these potential concerns by presenting new demographic d

  • Using Amazon Mechanical Turk for linguistic research1

    سند علمی۲۰۱۰Tyler Schnoebelen, Victor Kuperman

    Amazon’s Mechanical Turk service makes linguistic experimentation quick, easy, and inexpensive. However, researchers have not been certain about its reliability. In a series of experiments, this paper compares data collected via Mechanical Turk to those obtained using more tradit

  • Lessons Learned from an Experiment in Crowdsourcing Complex Citizen Engineering Tasks with Amazon Mechanical Turk

    سند علمی۲۰۱۴CoRRMatthew Staffelbach, Peter Sempolinski, David Hachen, Ahsan Kareem

    America’s dated infrastructure is failing to keep pace with its burgeoning population. In fact, the average grade in ASCE’s (American Society of Civil Engineers) 2013 report card for America’s infrastructure was a D+, with a 3.6 trillion dollar estimated investment needed by 2020