What happens if I have completed only a few annotations?
If you have only completed a few annotations in a project or over the course of the month, the resulting accuracy score will not have high confidence. This means that SUPA will not have confidence that your accuracy score reflects your capability in running the project.
For example:
The annotators highlighted in red above have all achieved a score of 100% in this project. However, judging from the number of annotations shown, this score of 100% will have been from 2 or 3 leads at most.
The more tasks that you do, the more confident you will be that your accuracy score correctly reflects your capability. Additionally, the more confident the PMs in SUPA are in your accuracy score, the easier it will be for them to make decisions on what opportunities you’re available to do.