Standard Setting is the process used to determine exam outcomes for candidates. Practique includes several common Standard Setting methods, each of which can be customised, and additionally allows you to use custom Standard Setting methods.
Supported Standard Setting Methods
Each item in the item-bank can be assigned an Angoff percentage, representing the percentage of minimally competent candidates* (borderline) that would be expected to know the correct answer to the item.
Practique has full support for Ebel standard setting, allowing each exam paper to be standard set by a group of invited judges. The Ebel matrix can be customised, and difficulty and relevance can be input by each judge, and the Ebel score automatically calculated for each item in the exam. Ebel score histories are kept for each item in the item bank, allowing Ebel scoring trends over different exams and exam papers to be tracked separately in the item bank.
The borderline group method only applies to examiner marked exams. For each item the examiner can indicate a global mark for each item answered by the candidate, which can have multiple levels, but minimally pass/borderline/fail. The pass mark is determined by analysing the borderline group of candidates.
Similar to borderline group, the examiner specifies a global mark for each item answered by the candidate, which minimally has pass/borderline/fail levels. The pass mark is determined by constructing the regression line through all of the groups.
McManus Borderline Regression
Similar to borderline regression, the examiner specifies a global mark for each item answered by the candidate, which minimally has pass/borderline/fail levels. The pass mark is determined by constructing the regression line through all of the groups and combining with a negative confidence interval.
It is possible to normalise the marks for each item in an exam to a consistent number. You may want to do this so that each item in an exam is equally weighted, despite having an inconsistent number of marks for each item. Note that the normalisation is on an item basis, and not on an exam basis. It is possible to revert to non-normalised scores.
Minimum Items to pass
When you are on the standard setting page you can set the minimum number of stations to pass an exam. Enter the number and click "apply" this will recalculate the number of passes and fails based on this additional criteria and the total score. If you wish to only pass on stations then you should set the "passing score" to zero.
Candidates are the individuals who are assigned to take or sit an exam within Practique. The minimum information Practique requires for a Candidate is their ID. The ID must be unique otherwise there is a risk of duplication within Practique.
*It is important that the assessment function has a clear definition of what a borderline or minimally competent candidate is, and whether these are equivalent