Extended Blueprint (LO)
  • 13 Jun 2023
  • 5 Minutes to read
  • Contributors
  • Dark
    Light
  • PDF

Extended Blueprint (LO)

  • Dark
    Light
  • PDF

Article summary

In addition to manual selection, you can also opt for automatic selection based on a blueprint matrix. For this option you will have to choose 'Blueprint' during step one. 

When using a blueprint matrix you can let the system pull questions for you.Extended Blueprint is our most advanced option to let the system pull questions for you.

In order to use this functionality, your items have to include Learning Objectives and Taxonomies. These are being used to set up a matrix to pull questions.

How to create an Extended Blueprint

Make sure you have selected 'Blueprint' at the first step or go to your assessment options (3 dots in the right upper corner) to change it.

  1. Go the 'Question Selection' tab
  2. Click Add blueprint> Extended Blueprint
  3. Cirrus will present a list with available collections that include Learning Objectives and Taxonomies
  4. Select one collection; the LOs and Taxonomies of this collection will function as a starting point to build the matrix
    Blueprint will be build from 1 collection, but all questions will be used

    It's only possible to choose 1 collection from which you can build a blueprint matrix, but the questions will be picked from all available collections which you have available in your Library
    You can still adjust the blueprint matrix by adding/deleting LO's if needed.



  5. The horizontal axis shows the Taxonomies, the vertical axis shows the Learning Objectives.
  6. The fields show the total available questions per LO topic versus Taxonomie (Example subject)
  7. Below you see it broken down into the different LOs inside of the topic
  8. First you have to specify per topic how many questions you want to include in your assessment of that topic
  9. Second you can specify per LO/Taxonomie how you want to divide the total number available per topic, over the different LOs inside of that topic
  10. This way you decide how many questions out of each topic and from each underlying LO will be used in your assessment
  11. Use +Add Learning Objective to add more LO-topics and underlaying Learning Objectives
  12.  Use the dropdown to select another Taxonomy (if available)

Blueprint options

Use the cog icon to select specific Blueprint settings:


Fix question pool on publish
Normally the items of the question pool which is aligned with the blueprint will be used. This means after creating an assessment with a blueprint, later added questions that match the LOs/Taxonomies will also be included in the assessment.

However when enabling this setting, the question pool will be fixed when publishing the assessment. No newly added questions will be included.

Item Types
Select which question types you wish to include if you only want specific question types in the assessment. It's basically a filter of question types. 

This allows you to make sure certain question types will never be included. Using this you can ensure only non-human-marked questions can be drawn so your assessment can be scored automatically. In that case, make sure "Essay" and "File response" are disabled. 

it allows you to publish the assessment with the option "Do not assign Assessors".

 (show advanced options)

Item purpose
Choose between Summative, Formative or Both. Meaning your blueprint will be based on questions marked as Summative or Formative.

Summative or Formative?
When creating items authors can mark a question as being Summative or Formative. See here for more information.

Sections - Count section as one item
When enabled a section with 3 questions will counted as 1 item. 

More info on the matrix

Once you have selected Learning Objectives and Taxonomies the blueprint will appear on your screen:

  1. Use the blueprint to select the minimum and maximum number of items you need of each Learning Objective and Subject against each taxonomy term.
    For example, there are a total of 24 items tagged with Learning Objective 'Bank Reconciliation' and taxonomy term 'Knowledge'. If I want 5 of these in my assessment I enter ‘5’ into both the Min and Max fields. I cannot set a minimum or maximum number for items tagged with Learning Objective 'Bank Reconciliation' and taxonomy term 'Understanding' as there are none available.
  2. To remove a Learning Objective or Subject you can select it and click on the "delete" button.
  3. Click the ‘cog’ button in the top-right corner to open the ‘General Settings’ for the blueprint to define the Question types you wish to include if you only want specific question types in the assessment.
  4. Please note you can change the question selection matrix up until you generate an assessment form. After that you will not be able to change it and receive a warning stating "You have already created a form based on this blueprint. In order to change the blueprint you need to delete the form."
  5. Please note the remarks on which questions will be available in your matrix below:

Remember when using Blueprint:

      1. Available questions (1): When creating a blueprint assessment the questions available are depending on the type of assessment and will consist of only summative questions, consist of only formative questions, or consist of both types (mixed).
      2. Available questions (2): Items will/can be picked for a blueprint assessment if they are 'Live' and have a match on their Learning Objective and Taxonomy.
      3. Available questions (3): Only items with one Learning Objective will be available for selection using Blueprint.
      4. Question order: items will be presented in the order
        1. You add your Subjects to the blueprint
        2. Below that in the (alphanumeric) order of the Learning Objectives in your Blueprint
        3. To randomise the order select the option 'Display questions in random order' on your Assessment options
      5. The use of Learning Objectives in general and the feedback options it offers in Cirrus can be found via our article on 'Using Learning Objectives in your e-assessments'.
      6. Available questions (4): for (random) blueprint based assessments the candidates assessment will use questions that were Live when the schedule was created.

Example of available questions and their use over time in a random blueprint exam:

  1. I have a pool of 100 when the assessment is published. The assessment pulls 50 at random.
  2. I create 200 more questions (with LO's/Subjects and Taxonomies that match the blueprint)
  3. I schedule the assessment
  4. The scheduled assessment will pull 50 out of 300 questions at random.
  5. If you create your schedule a long time ahead of time you will only pull 50 out of 100 questions. In this case you need to create a new version of the assessment so your schedule-created-ahead-of-time will pick up the new questions (50 out of 300)

 

When you have finished setting up the blueprint, you are ready to generate the assessment. Once you have selected all the items you need, go to the next step ‘Step 4 – Generate Assessment’.

 


Was this article helpful?