Scoring
  • 01 Apr 2022
  • 4 Minutes to read
  • Contributors
  • Dark
    Light
  • PDF

Scoring

  • Dark
    Light
  • PDF

Article Summary

The scoring page for manual and autoscored questions are generally the same, but essay question types have more options since they are manual scored. 

On the ‘View and Mark screen’ you can score the question, leave an overall conclusion and view / make annotations:

  1. Use this part of the bread-crumb to return to the overview of all candidates for this schedule or to go to the candidate summary screen
  2. Navigation bar - allows the marker to navigate to the next question/candidate (< and >) or use the dropdown next to the candidate name to navigate through his/her answers.
  3. Question - shows the question text
  4. Answer - shows the candidate's answer and if enabled a word and character count. In our example the marker has left comments which are visible upon mouse-over and marked red or yellow.
  5. Notepad - Shows comments from the candidate for this specific question. Will only be available if been activated in assessment options and filled in by candidate.
  6. Use these navigational buttons (a mouseover tells you which is which) to move between the 'Scoring', 'Marking scheme' or 'Section'  for the item (when the item is part of a section of course). 
  7. Scoring progress + selecting another assessor - Shows the progress of the candidate scoring. Also you are able to see the other assessor scoring when two assessors are applied on the same question in the coordinator tab
  8. Score -this is were you enter the points scored for this question. You can chose for 'Save' or 'Save and next candidate' or 'Save and next answer' using the button.
    Scoring - Progress tells you how far you are in marking this candidate. The Max Score possible for this question is also shown.
  9. Overall Feedback -  In the Feedback conclusion box you can enter the reasoning behind the score. This can be made visible (exported) for feedback or appeals for example. This can also be showed on the candidate dashboard or review session
  10. Annotations - Use the dropdown to see an overview of your or other assessors annotations (when enabled by your marking coordinator). Use the annotation buttons to make or view a list of  inline comments on the candidate answer.
  11. The "<<"-button can be used to open or close the side-bar (right column).

Auto-scored question types

By default auto-scored will be automatically and will show the score on the scoring page.
In case 'Manually score auto-scored questions' (can be done on assessment publishing screen or 'coordinator settings tab') is enabled then you need to score the questions.
The scoring will be pre-filled by the system, but as a marker you are allowed to overrule this.

The following functionalities will not apply on the scoring page for auto-scored questions:

  1. Annotation
  2. Feedback
  3. Criteria based marking
  4. Marking schemes


Annotations/feedback before Scoring an Item 

Cirrus offers several options for annotating a manually scored Item such as Essay questions:

  1. A text field is provided for an Overall Feedback.
  2. You can highlight specific passages of the provided answer(shown in yellow)
  3. You can strike-through specific passages of the provided answer (shown in red)
  4. Annotation overview - shows all your comments on this answer. If there are multiple assessors, you can view all comments here if this has been allowed by the coordinator.

    You can highlight or strike-through specific passages of the provided answer:
    1. Click on the tool of your choice
    2. Select the text to comment on.
    3. Leave a comment and click on ‘Insert’:
    4. You can view a specific comment by moving your mouse over the highlighted text

Make feedback & annotations visible on the candidate dashboard

Set  assessment option:
  1. Show candidate result’ > ‘when assessor decides’.
  2. Candidate experience > Results> enable 'Detailed'

Once you are publishing the results (in result tab) you have the option to show the results on the dashboard of the candidate. At this moment you decide if you would like to share the results with the candidate. Based on the assessment option the results will be made visible in the candidate dashboard filter > completed

The 'general feedback' will be visible for the candidates.
Annotations will not be made visible on the candidate dashboard results! 

Annotations can only be made visible via a review session and enable 'show annotations' setting.

Scoring per Item

‘Save and next candidate’ gives you a means for horizontal scoring or scoring per Item: looking at our example this means the Marker first scores all answers to question 2 of the test, then all answers to question 4 of this test. It can also mean that you score all answers to the first Essay question, while a colleague scores all answers to the second Essay question of the test.

Scoring per Candidate

‘Save and next question’ gives you the means to score per candidate, meaning that you score all responses to manually scored items of that candidate before moving to the next candidate and her/his answers.

When you've reached the end of you list of candidates to score you can this because the "Save and next Candidate"-button will 'gray' out / deactivate. If you enter a different score the button will become active again:


File response

A file response question type needs to be manually marked and works similar as other question types. The only difference is that the answer will be given in a downloadable file.

General feedback is possible, but annotations will not be.

Criteria marking

Instead of giving a single score, you can mark the scoring based on criteria for only the question types essay and File response.
By giving the sub-criterion either a direct score or using the slider, the criterion will automatically be counted and shown in total.
Using criteria marking gives your markers a better overview on which criteria candidates should be marked on.


Office 365 Marking

A file response question type which includes an office file from a template will be embedded into the Cirrus marking.

The embedded file can only be viewed by the marker. Changes cannot be made by the marker.

To give a full overview of the file, you are able to open the file in a new tab, e.g. to see the formula's which been used in excel.
Annotations are not possible to use within the office files.




Was this article helpful?