45
Table of Contents
Welcome..................................................................................................................................... 1
How Do I...?.........................................................................................................................1
Introduction to Mechanical Turk........................................................................................................2
Overview of Mechanical Turk...................................................................................................2
Advantages..................................................................................................................2
Mechanical Turk Concepts......................................................................................................3
Requesters.................................................................................................................. 3
Human Intelligence Tasks (HITs)......................................................................................3
Assignment..................................................................................................................3
Workers.......................................................................................................................3
Approval and Payment...................................................................................................3
Qualification Type..........................................................................................................4
Getting Started with the Requester UI...............................................................................................5
Using the Requester User Interface..........................................................................................5
Creating a Project..........................................................................................................................7
How to Create a Project..........................................................................................................7
How to Create a Categorization Project...................................................................................15
How to Create a Sentiment Project.........................................................................................19
Publishing a Batch.......................................................................................................................24
How to Publish a Batch.........................................................................................................24
Managing Batches.......................................................................................................................28
Displaying Batch Progress, Details, and Results........................................................................28
Configuring the Review Results Page......................................................................................30
Filtering Results..........................................................................................................31
Approving and Rejecting Assignments.....................................................................................32
Reviewing Assignments................................................................................................32
Reviewing Assignments Offline......................................................................................33
Approving Previously Rejected Assignments....................................................................36
Deleting a Batch..................................................................................................................37
Managing Workers.......................................................................................................................39
Viewing Worker Statistics......................................................................................................40
Blocking a Worker................................................................................................................41
Unblocking a Worker............................................................................................................42
Awarding a Bonus................................................................................................................44
Assigning a Qualification to a Worker......................................................................................45
Revoking a Worker's Qualification...........................................................................................47
Managing Worker Details Offline............................................................................................48
Managing Qualification Types.........................................................................................................51
Creating a Qualification Type.................................................................................................52
Viewing Existing Qualification Types........................................................................................53
Deleting Qualification Types...................................................................................................53
Document History........................................................................................................................55
iii
Amazon Mechanical Turk Requester UI Guide
