Annotation Quality Settings

July 19, 2024 ยท View on GitHub

In this guide we'll show you if you need to tweak some aspects of comparisons, you can do this from the Annotation Quality Settings menu.

You can configure the word error rate (wer) threshold, character error rate (cer) threshold, compare extra parameters or not (emotion, locale, gender, etc), and compare attributes or not.The updated settings will take effect on the next quality update.

To open Annotation Quality Settings follow the steps:

  • Find Quality report and on the right side of it, click on the setting icon inside the Analytics of task page. alt text
  • Note: If you find difficulty to find the Analytics of task page then click here
  • The following window will open after clicking on the setting icon. alt text
  • Annotation quality settings have the following parameters.
FieldDescription
WER thresholdMin word error rate threshold is used for matching transcript.
CER thresholdMin character error rate threshold is used for matching transcript.
Compare extra parametersEnable or disable extra parameters checking (emotion, locale gender, etc)
Compare attributesEnable or disable attribute comparison.