8.8 Guidance for Markers of Written Exams
Marking SAQ/MWQ items
When a marker logs in to risr/assess, their dashboard will display all marking assignments separated by exam. The following information is shown for each:
Exam / Block / Item - Exam information
Variant - Language variant used (where applicable)
Not started - the number of candidates for whom marking has not started
In progress - the number of candidates who are currently being marked
Completed - the number of candidates who have been marked
For the exam the marker wishes to mark:
Click Mark
The first (random) candidate's marking sheet will display
What the marker sees as a candidate identifier is a configuration setting per instance:
Candidate ID (GMC number)
No information
Marking ID (assignment object)
Candidate name
Enter marks using the dropdown menu provided for each Marking area
The marker can then do any of the following:
Save marks (marker can access this candidate again)
Confirm marks (marker will not be able to modify marks)
Reassign to the other language marker (for bilingual exams only)
Enter notes that can be included on the candidate feedback report
Enter comments that candidates will never see. Only exam administrators, reviewers or senior markers (where applicable) will see these comments.
From the dashboard, the marker can click Overview to see a summary of all candidates and their status.
Marking VSAQ items
For markers, VSAQ marking differs from SAQ/MWQ marking as all responses from all candidates are marked on a single screen
When a marker logs in to risr/assess, their dashboard will display all marking assignments separated by exam. The following information is shown for each:
Exam / Block / Item - Exam information
Variant - Language variant used (where applicable)
Not started - the number of responses expected
In progress - the number of responses still being marked
Completed - the number of responses marked
For the exam the marker wishes to mark:
Click Mark
All responses will be displayed
All known responses will automatically be marked and confirmed. No action is needed. These are shown highlighted green and with Confirmed appearing next to the score.
All unknown responses will be categorised according to the Levenshtein distance set at the exam level.
VSAQ items can be set to case sensitive or not case sensitive. If set to no, in the example both responses red and Red will be on the same line.
The responses can be sorted by Response, Number of responses or Score.
The marker can filter the responses by typing in the free text box provided and searching.
Enter marks using the dropdown menu provided for each Marking area
The marker can then do any of the following:
Save (marks will remain editable)
Confirm (marker will not be able to modify marks)
Add (this will create a new version of the item and add the response and mark provided. The item will remain in draft state until approved)
Reassign to (for bilingual exams, the marker can reassign that response to the other language marker)
Click Confirm All and Close (if the marker did not confirm marks individually then they are able to confirm all marks and close the page successfully using this function)
Click Save and Close (If the marker did not Save or Confirm each individual response, this action will save them all before being brought back to the dashboard).
Reviewing items
When a reviewer logs in, the dashboard will display the following for all their assigned items:
Exam / Block / Item - Exam Information
Variant - Item variant (language) where applicable
In Progress - For SAQ/MWQ this shows the number of candidates being marked
Completed - For SAQ/MWQ this shows the number of candidates who are marked and confirmed
In Progress - For VSAQ this shows the number of responses being marked
Completed - For VSAQ this shows the number of marked and confirmed responses
Once the marker has confirmed marks, the reviewer can begin:
Click Review marks
For SAQ or MWQ, the reviewer can either:
Click Needs further review which will keep this candidate in progress.
Click Review complete which will mark this candidate as complete.
The reviewer will be brought to the next random in progress candidate. The dashboard will show the reviewer’s progress across all assignments.
The reviewer can click Overview to see their progress for that specific assignment.
For VSAQ:
The reviewer can only click Review Complete beside each confirmed response
The status will indicate Confirmed Reviewed.
Marking as a Senior Marker
When a senior marker logs in, the dashboard will display the following information for all assigned items:
Exam / Block / Item - Exam information
Variant - Language variant for the item, where applicable
In Progress - For SAQ/MWQ this shows the number of candidates being marked
Completed - For SAQ/MWQ this shows the number of candidates marked