How to Adjust AI Assessment Criteria?
Adjusting AI assessments allows correcting AI errors and adding comments to criteria for providing clear feedback to operators.
When It Will Be Useful
- AI incorrectly assessed a criterion (for example, mistakenly set "failed" instead of "passed").
- You need to change criterion scores after QA specialist review.
- You need to add a comment explaining the assessment for the operator.
What's Important to Know
- AI assessment — automatic criterion assessment performed by AI based on dialogue analysis.
- Adjustment — changing criterion assessment by QA specialist with mandatory comment.
- Changed criteria — criteria that were changed by QA specialist are highlighted in a special color.
- Final score — automatically recalculated after changing any criterion.
- Critical criterion override — if a failed critical criterion is stored with 0 points (no penalty), the overall score may not be zeroed. The Points field shows 0 instead of the default penalty.
- Non-critical criteria — after choosing Violated, you can click Change score and enter a partial penalty within the allowed range.
- Critical criteria — only the Passed / Violated toggle and the comment field are available; there is no separate manual score field.
Before You Start
Step-by-Step Instructions
1. Open Assessment Details
- In the Quality Assurance module, go to the "Assessments" section.
- Find the needed assessment in the list and click on it.
- The "Assessment Details" page opens with dialogue transcript and interactive checklist.
2. Review AI Assessment Criteria
- In the right part of the page, review the interactive checklist with criteria.
- Each criterion shows:
- AI Result — passed/failed, scores, AI comment.
- Criticality — whether the criterion is critical.
- Check if all AI assessments are correct.
3. Identify AI Error
- Review the dialogue transcript and compare with AI criterion assessment.
- If AI incorrectly assessed a criterion (for example, set "failed" instead of "passed"), it needs to be corrected.
4. Adjust Criterion Assessment
- Find the criterion that needs to be corrected in the checklist.
- Use the Passed / Violated toggle to choose whether the criterion is met (this replaces separate "grant" / "cancel score" actions).
- In the form that appears, mandatorily enter a comment explaining the change (for example, "AI incorrectly assessed — operator correctly performed the action").
- If the criterion is not critical and you selected Violated, click Change score if you need to enter a new score within the allowed range (for example, a partial penalty).
- For critical criteria, the New score field is not shown — only the toggle and comment; the penalty follows the criterion configuration.
- Click "Confirm Changes".
5. Verify Changes
- After saving, the criterion is marked as changed (highlighted in a special color).
- The final assessment score is automatically recalculated based on all criterion assessments (including changes).
- The "Approve" button displays the number of changed criteria.
6. Revert All Changes (if needed)
- If you made several changes but decided to return to the original AI assessment, click the "Revert All" button.
- All changes are reverted, criteria return to AI assessments.
- The final score is recalculated to the AI score.
What Happens After
Changes are applied to the assessment:
- The criterion is updated with new values and comment.
- The final score is automatically recalculated.
- Changed criteria are highlighted in the interface.
- After approval, the operator will see both AI comments and QA specialist comments.
How to Verify Everything Worked
- Check that the changed criterion is highlighted in a special color.
- Check that the final score is updated according to changes.
- Check that the comment is displayed in the criterion.
- Check the changed criteria counter in the "Approve" button.
Related Materials
Important Notes
- 📝 Mandatory Comment: When changing criterion assessment, you must add a comment explaining — without a comment, changes are not saved.
- 🔄 Automatic Recalculation: The final score is automatically recalculated after changing any criterion — no need to recalculate manually.
- 🎨 Change Highlighting: Changed criteria are highlighted in a special color — this helps quickly find all adjustments.
- ↩️ Reverting Changes: You can revert all changes and return to the original AI assessment — this is convenient if you made a mistake.