Six steps
The calculation chain from question to programme outcome
Each step uses the result of the one before. Values such as the threshold, target and weights are institutional decisions and may vary between institutions.
1The student's outcome achievement
A student's achievement on a learning outcome is derived only from their scores on the questions that measure that outcome. If a question measures more than one outcome, its marks are shared between them.
Why does it matter? Unlike the course grade, achievement shows where the student stands in that competence. The blank score of a student who missed the exam is not counted as zero.
2The class attainment rate
The attainment rate shows how many of the measured students pass the achievement threshold set by the institution for that outcome. The result is compared with the target rate.
Why does it matter? This is the number that goes into reports. Average achievement is supplementary: a few high scores can hide the majority who missed the threshold. If the number of students is below the minimum group size, the result is not shown.
3Validity gate: are the questions at the outcome's level?
The Bloom level of the questions measuring an outcome is compared with the outcome's target level. If the questions are clearly below the target, the result is not published or is published with a limitation statement.
Why does it matter? A high attainment rate measured with questions below the target is misleading: the student has not been tested at the level the outcome requires.
4The course's contribution to the programme outcome
The attainment rates of a course's learning outcomes are carried to a programme outcome according to the strength of each outcome's contribution to it.
Why does it matter? Only outcomes that pass the validity gate are included. A single course does not represent the programme; the programme value combines all courses.
5Programme level: all courses together
A programme's value for an outcome is calculated from all the courses that feed it together. The courses' workload and whether they are elective or compulsory are taken into account.
Why does it matter? Because not every student in the programme takes an elective course, its contribution is kept lower than that of compulsory courses. The result represents all students in the programme.
6Evidence layers: courses, graduates, employers
A programme outcome at graduation does not rest on course measurement alone. Course measurement, the employer survey and the new graduate survey are combined with weights set by the institution.
Why does it matter? If the layers diverge clearly, the result is cautiously pulled down, because it cannot be known which one is right. Without course measurement, a programme outcome is not declared from surveys alone.