When properly set up, Evaluation Tasks are the primary way to monitor the overall quality of a project, and will also be a big indicator of how successful your Production batches will be.
Inspect common answers
Look to see what are the trends in the task completions through the Common Answers feature.
Inspect common answers
Look to see what are the trends in the task completions through the Common Answers feature.
This specific selection will show results that are 0-50% accurate
Create more comprehensive training
Through looking at Common Answers you can identify which tasks have a lot of common mistakes. These tasks are good candidates to be used as Training Tasks.
For any task, you can easily Convert into a training task right at the Task view.
Clicking Convert allows you to convert to training task
Add common mistakes to your Instructions
Common mistakes can also be included in your Instructions to provide examples of what not to do to the taskers.
In Definition you can access Advanced controls and automatically convert rejected audits into common errors in your Project Instructions.
Common errors updates adjust your Instructions to include rejected audits
Tune grading
Adjusting the ranking of responses will update the grading and create a quality grading system more in tune with your needs
Access Tune Grading through Quality Lab
Adjust a random sample of 5 tasks to be ranked from best to worst - this ranking will tune the grading if a valid grading configuration exists for that order