What are pass fail criteria: pass/fail criteria explained

Pass fail criteria are the rules that convert an inspection measurement or observation into a binary verdict, so that an item is either accepted or rejected. They sit downstream of the standard itself, and they are the point at which a measured value becomes an operational decision with consequences attached.

The distinction from the standard is not academic. A tolerance says what conforms. A pass fail rule says what you do about a reading that sits near the edge of it, which is a separate and much harder question.

What do pass fail criteria mean in practice?

Three elements have to be pinned down before a verdict is reproducible:

• The tolerance limit: the boundary of what conforms, taken from the inspection criteria.
• The acceptance limit: the value at which you actually reject, which is not always the same number.
• The aggregation rule: how item level results combine into an overall verdict for the asset or the lot.

That last one is routinely left undefined and causes real trouble. If eleven of twelve checks pass, is the asset a pass? The honest answer depends on which check failed, which is why pass fail criteria and defect classification have to be designed together.

How pass fail criteria are set

The rigorous treatment comes from metrology. JCGM 106:2012, the international guide on the role of measurement uncertainty in conformity assessment, sets out the four possible outcomes of a binary decision rule: valid acceptance, valid rejection, false acceptance, and false rejection.

False acceptance is called the consumer's risk, because the cost lands on whoever accepts the item as fit for purpose. False rejection is the producer's risk. Because the true value can never be known, both risks are always present, and moving the acceptance limit to reduce one of them always increases the other.

The standard mechanism for controlling this is a guard band: setting the acceptance limit inside the tolerance limit, so that a reading has to clear the specification by a margin before it passes. ISO/IEC 17025:2017 makes the same point a requirement for laboratories, obliging them to apply and report a documented decision rule that accounts for measurement uncertainty and the associated level of risk.

What a binary verdict throws away

A pass fail result is the smallest possible summary of an inspection. By the time it reaches the record, almost everything that made the inspection useful for managing the asset has been discarded.

ISO 9000:2015 acknowledges this in its own definition of inspection: the result can show conformity, nonconformity, or a degree of conformity. That third option is the one operations teams need and the one most inspection records do not capture.

Consider a brake pad with a 3 mm service limit. Readings of 3.1 mm, 3.1 mm, 3.1 mm across three successive inspections all record as "pass", and so do readings of 7 mm, 5 mm, 3.1 mm. The first asset is stable and the second is about to fail, and a pass fail record cannot tell them apart. An inspection that only stores the verdict cannot tell you whether you are drifting toward failure, which means it can support compliance but not planning.

Pass fail criteria explained: a worked example

The UK MOT test is a clean public example of pass fail criteria with a severity scheme built in. Since 20 May 2018 the DVSA has recorded defects in four categories: dangerous, major, minor, and advisory.

Dangerous means a direct and immediate risk to road safety and the vehicle fails. Major means the defect may affect safety or put other road users at risk, and the vehicle also fails. Minor means no significant effect on safety and the vehicle passes with the defect recorded, while an advisory flags something that could become serious later. Two of the four categories fail, two pass, and the record still carries the detail.

What to record alongside the verdict

The practical answer to information loss is to stop treating the verdict as the record. Alongside pass or fail, capture:

• The measured value, with units, for anything measurable, not just the comparison result.
• The image for anything judged visually, taken under the stated viewing conditions.
• The criterion version applied, so a later reviewer knows which standard was in force.
• The near misses, meaning passes that fell inside the guard band, because they are the leading indicator.

Do that consistently and the same inspection that satisfies an auditor also drives maintenance intervals, supplier scorecards, and warranty argument. Skip it and you are running the inspection twice: once for compliance and once again, informally, when somebody needs to know how bad it actually was.

How pass fail criteria relate to the rest of the inspection design

Inspection scope sets the boundary, criteria set the standard, pass fail criteria turn the standard into a decision, and classification sorts what failed. An inspection checklist is the instrument that carries an inspector through all four.

Where the person making the call is not standing next to the asset, the measurement and the image have to travel with the verdict for the decision to mean anything. Venta Capture, a product of VentaVid, is built for that step: it guides the person on site through a defined capture sequence so the readings and images an assessor needs arrive with the submission. The assessment itself stays with the qualified human, which is where a pass fail decision belongs.