Rescoring
  • 13 Jun 2022
  • 3 Minutes to read
  • Contributors
  • Dark
    Light
  • PDF

Rescoring

  • Dark
    Light
  • PDF

Article Summary

After "auto-scoring" by the system or "marking by assessors" is done, results are submitted in Cirrus. This means that they are ready for the next step: publication

It is however always possible that a mistake is discovered in one of your questions during or after marking. For this you can use Rescoring: authorised users can change the question score for a whole group of candidates that where scheduled to take the assessment together.

Example:

Let's look at an example of a test with 1 MC and 1 numeric question (1 point each)
The candidate gets the MC question correct, but the numeric question needs to be reconsidered

In short you can:

1. Give full score for the numeric question > the candidate will score 2/2 points
2. Remove the numeric question > the candidate will score 1/1 points.

How to authorise users to become re-scorer for a scheduled group of candidates

The 'Rescoring-tab' has permission-based access: user administrators can define who can see which results:

  • Users should have Admin > Roles > Marking: 'View Rescoring tab' turned on.
  • In the user administration you give access to specific hierarchies: check the box under Admin > User > Hierarchy > Re-score (inherits down).

The Rescoring-tab: your overview

The Rescoring-tab will show all schedules for which all results have been submitted and the schedule time has ended. Rescoring is available only for assessments with fixed form. If none of your candidates in the schedule submitted work, it will not show up here:


Available actions under rescoring

Rescoring can be done per schedule before/after submission or publication of all results (the schedule needs to have ended). 

  • To start rescoring select a schedule by clicking on the title on the rescoring-tab.
  • On the next screen you will see the question listed delivered via that schedule: 

On the Rescore-tab for a schedule the following actions will be available:

  1. Select a question to rescore by clicking on it - it will stay high-lighted
  2. Choose the action you want to take:
    1. Award 'Full Score' for the question: all candidates in the schedule will receive the maximum amount points for this question
    2. Remove questions from Scoring: the question will no longer be taken into account towards the passmark and grade for all candidates in the schedule
    3. Change - you can change the correct answer for Multiple Choice, Multiple Response and Either/Or questions or the maximum score for the question. Also it's possible to adjust the score for Essay and File upload question with or without criteria bases scoring.

Please note: you can only rescore a question once after you've applied the changes in the right top corner by clicking 'Apply changes'

Assessment Statistics
Rescoring will be automatically be applied on the assessment statistics if rescoring took place after publishing the results. In case rescoring took place before publishing the results, the assessment statistics will not be calculated.

Consequences of rescoring:

What are the consequences of full score / remove / change answer / change max score?

Once you click on 'apply' the rescoring will take effect: the results for the candidates will be recalculated (this can take a little time) based on the new maximum score for the assessment if that was affected.

Rescoring will always made visible once the rescoring is applied for all users who have access to on of the following page:

  • Marking> Assess > Candidate summary screen
  • Marking> Rescoring
  • Marking > Audit
  • Reports > Candidate results

This will be shown via a star icon. When you hover over the star icon, you will see which rescoring action is applied, either, Full score, Removed, Answer Changed.

Rescored question not visible for candidates
The star icon which implies rescoring is done will not be shown on the candidate dashboard results or candidate review.


What effects will I see in Cirrus upon rescoring?

  • Rescoring the question will not influence psychometrics.
  • A rescored question will probably need to be looked at. Using the question ID you can withdraw it for example to ensure it will no longer be used.

Visibility of rescored questions:

  • On Marking > Results tab and in Reports and on Candidate Dashboard new (recalculated results will show)
  • Removed questions won’t be shown anymore
  • Removed questions won't be shown in the candidate review session
  • Full score will be shown with full score (no flag / indicator about change)
  • Changed question: will be shown with full score (no flag / indicator about change)



Was this article helpful?

What's Next