What is the Accuracy Scorecard?

The Annotator Accuracy Scorecard is a tool that shows your accuracy across different projects you have worked on in a month. Accuracy is a measure that lets you know your performance in a project based on the client’s instructions & is calculated from:

1. Correct Annotations: Correct object annotated tightly and with correct label
2. Wrong Annotations: Can be one of the following:
   1. Mislabel: Annotated object with the wrong label e.g. labeled a cat as a dog
   2. Misdrawn: Object annotated too tightly or loosely
3. Missing Annotations: Object should be annotated but was not

Note: To understand how it’s calculated, click here

The purpose of the scorecard is to pinpoint areas of improvement for annotators. You will still be paid out for wrong annotations but consistently low accuracy could result in a strike. Enough strikes could result in a temporary ban & mandatory training.