When More Evidence Means Less Assurance: Rethinking the Over-Assessment Habit
Photo: W.carter, CC BY-SA 4.0, via Wikimedia Commons
The instinct that feels like rigour
Ask an experienced assessor why a learner has submitted eleven pieces of evidence for a single criterion and the answer is rarely analytical. It is defensive. More evidence feels safer. It looks thorough in a file review. It anticipates the question an external quality assurer might ask, and it forecloses an argument before it starts.
The trouble is that sufficiency and volume are not the same thing, and treating them as though they were carries real costs that rarely appear on any risk register. This piece argues that over-assessment is one of the more quietly damaging habits in UK vocational assessment, and that right-sizing evidence is a professional judgement worth defending.
How over-assessment creeps in
Nobody designs a qualification to require duplication. Over-assessment accumulates through small, individually reasonable decisions.
An assessor adds a reflective account on top of an observation because the observation was on a quiet shift. A team standardises a minimum evidence requirement that quietly becomes a maximum, because nobody wants to be the outlier. A previous external visit produced an action point about a single learner file, and the response was a blanket increase in requirements across the cohort. A template gains a field, then another, and the fields outlive the reason they were introduced.
Each decision is defensible in isolation. Together they produce a regime where learners spend hours producing documentation that adds nothing to the demonstration of competence, and assessors spend hours reading it.
What it actually costs
To learners. Over-assessment is an inclusion issue before it is an efficiency issue. Learners with additional needs, those in shift-based employment, and those balancing caring responsibilities all bear the cost unevenly. A requirement that adds two hours a week to a portfolio is a mild inconvenience for one learner and a barrier to completion for another. Excess evidence demands also tend to favour learners who write fluently, which is rarely the competence being assessed in a practical occupational standard.
To assessors. Every additional artefact must be requested, tracked, read, judged and recorded. Multiply that across a caseload and the effect is a reduction in the time available for the things that genuinely improve validity: observing practice, asking good questions, giving useful feedback.
To validity. This is the least intuitive point and the most important. Validity is not improved by accumulation; it is improved by fitness for purpose. A single well-observed workplace performance, followed by a probing professional discussion, often provides stronger assurance of competence than five documents that restate the same claims. Redundancy creates the appearance of corroboration without adding independent information.
Three tests for whether evidence earns its place
Before adding a requirement, apply three questions.
- Does it test something the existing evidence cannot? If it covers the same criterion through the same method, it is duplication.
- Could it be reasonably completed by every learner on the programme? If not, it is an inclusion risk masquerading as a standard.
- Would its absence genuinely weaken the decision? If the answer is no, it is decoration.
An audit for your own caseload
The following questions can be applied to a sample of five learner files in under an hour. They are not compliance checks; they are prompts for professional reflection.
- How many pieces of evidence map to each criterion, and is that number consistent by design or by accident?
- Which evidence items were requested by the assessor, and which were required by the assessment strategy?
- Are there criteria with three items where one would suffice to support the same decision?
- Which evidence items have you never used to justify a judgement?
- Have any learners submitted near-identical documents for adjacent criteria?
- Does the portfolio require written work where observation would be equally valid?
- How long did your last five feedback conversations take, and how much of that was about evidence collection rather than practice?
- Were any reasonable adjustments effectively compensating for an over-specified evidence requirement?
- If a new assessor joined tomorrow, what would they infer the minimum requirement to be from the completed files?
- What would you remove first if caseload doubled?
A framework for right-sizing a decision
Where an assessor is unsure whether to request more evidence, a structured pause helps.
Step one: state the criterion in plain language. Not the wording from the standard, but what competence would look like in this workplace.
Step two: identify the primary method. What is the most direct way of observing or eliciting that competence? Usually this is performance in the workplace, a professional discussion, or a product of work.
Step three: test the existing evidence against the criterion. Ask whether a reasonable assessor, seeing only this, could reach the same decision and explain it to a third party.
Step four: identify the specific gap, not the general discomfort. If the gap is genuine, name it — for instance, no opportunity to demonstrate contingency planning on a quiet shift. Then request the narrowest evidence that closes that gap. If no specific gap can be named, the request is probably habit.
Step five: record the rationale. A one-line note explaining why the evidence was sufficient is worth more at external quality assurance than an additional document. It demonstrates deliberate judgement rather than accumulation.
The defensible position
The strongest defence against a challenge is not volume; it is a clear account of why the evidence collected was fit for purpose. Assessors who can explain their sufficiency reasoning — and who have removed requirements that no longer serve a purpose — are in a far better position than those who have simply gathered more.
Right-sizing evidence is not a shortcut. It is the exercise of judgement that the assessor role exists to perform. Where a centre's templates, standardisation meetings and IQA feedback consistently reward accumulation over reasoning, that is a cultural issue as much as a technical one, and it is worth raising through the normal quality channels.
The question to carry into the next file review is not "is there enough evidence?" but "is there enough evidence, and can I say precisely why?" Those are different questions, and only one of them improves practice.