Filters

You can use the filters at the top of the dashboard to refine the data displayed on the page.

The following filters are available:

• Teams
• Team Members
• Reviewers
• Scorecards
• Channels
• Assignments
• Languages
• Tags
• Autofailed Only

Metrics

The following statistics and metrics are shown on the QA Reviewers page:

Total Reviews

Total number of reviews completed, compared to the corresponding previous period

QA Score

Cumulative average QA score that reviewers gave on QA reviews, compared to the corresponding previous period

Audit Score

Cumulative average audit score that reviewers received, compared to the corresponding previous period

Origin

Source of the QA review (assignments, Stream, or manual creation)

Appeals

Indicates whether any QA reviews received appeals and how many were resolved

Calibrations

Number of calibrations completed and the cumulative average alignment score

Number of Team Members

Number of team members reviewed, compared to the corresponding previous period

To view additional metrics for an individual review, click Details in the corresponding row. A slide-out panel will appear with statistics for the selected reviewer:

Individual reviewer statistics include:

Reviews

Areas from which the reviewer started their reviews and the total cumulative number of reviews completed for the selected time period

Average QA Score

Average QA score the reviewer gave, with a standard deviation

QA Reviews over Time

Number of QA reviews the reviewer completed across a selected number of team members

Audits

Number of audits the reviewer received for the selected time period

Calibrations

Number of calibrations in which the reviewer participated within the selected time period, with the cumulative alignment score

User roles with the "View Audits" permission can also click See Audits to open the QA Audits page filtered to the selected reviewer.