ModelCensusopen-source ai reliability harness

Multiply three ordinal ratings and you get a precise-looking number with no meaning. Automotive FMEA replaced it with Action Priority in 2019.

why no RPN

Blog2 Jul 2026conceptfmeamethodgovernance

The number we refuse to compute

AI risk frameworks keep rebuilding the Risk Priority Number. The industry that invented it replaced it in 2019.

Every AI risk framework I review ends the same way: one risk score per use case.

Most of them are rebuilding the Risk Priority Number. Severity times occurrence times detectability, each rated one to ten. The automotive industry's own FMEA handbook retired it in 2019.

Why a single score accumulates debt

S 2 × O 9 × D 5RPN 90S 9 × O 5 × D 2RPN 90
Same score. One is mild, common and hard to catch. The other is severe. Ranking them equally is worse than not ranking them.

The ratings are ordinal. A severity of 8 is not twice a severity of 4. Multiplying labels gives you a number with a decimal point, no units, and a severe failure hiding in the middle of the list.

That is exactly why AIAG and VDA replaced it with Action Priority — a lookup table that ranks severity first, so a severity-9 failure cannot be averaged into comfort.

The reality on the ground

Risk Priority NumberS × O × DOne score, 1 to 1,000Severe-but-rare ranks mid-tablevs.What we publishSeverity axes per modeOccurrence, with an intervalDetectability: yours to rate

The third term is the one people miss. Detectability is how likely you are to catch a failure before a user does — which depends on your logging, your evals, your review. It is a property of your deployment. Rating it on your behalf would be inventing a number about a system I have never seen.

Rank by severity first

Do not let a common, mild failure outrank a rare, severe one because the arithmetic said so.

Report occurrence with its interval

A rate without one is a guess with a decimal point.

Rate detectability on your own system

Nobody outside your organisation can.

When one number is right

Inside one team, on one system, tracking one failure mode over time, a single number going down is real information. The moment it crosses into a risk register or a vendor comparison, split it back into its parts.

Does your AI risk register multiply ratings into a single score — and could a severity-9 failure be hiding inside it?

Every figure here describes something measured and committed. See the measurements · read the method