Real context moved 0.0pp on Dimensional-Analysis Failure.
~intervals overlap — not separated from no change
The model produces a quantity with inconsistent or wrong units, or mixes unit systems, yielding a dimensionally invalid result. The rule
A tank fills at 3 L/min for 4 minutes, then drains at 500 mL/s for 10 seconds. Net litres?
Let's break down the problem step by step: 1. **Tank fills at 3 L/min for 4 minutes:** - Volume filled = rate × time = 3 L/min × 4 min = 12 L. 2. **Then drains at 500 mL/s for 10 seconds:** - First, convert the drain rate to litres per second to be consistent with units (since 1 L = 1000 mL): - 500 mL/s = 500 / 1000 L/s = 0.5 L/s. - Volume drained = rate × time = 0.5 L/s × 10 s = 5 L. 3. **Net volume change:** - Net = volume filled - volume drained = 12 L - 5 L = 7 L. Answer: 7 L
detector fmi_4_4_v1: correct unit L
Let's break this down step by step. **Step 1: Fill phase** Rate = \( 3\ \text{L/min} \) Time = \( 4\ \text{minutes} \) Volume filled = \( 3 \times 4 = 12\ \text{L} \) **Step 2: Drain phase** Rate = \( 500\ \text{mL/s} \) Convert to litres per second: \( 500\ \text{mL/s} = 0.5\ \text{L/s} \) Time = \( 10\ \text{s} \) Volume drained = \( 0.5 \times 10 = 5\ \text{L} \) **Step 3: Net change** Net volume = \( 12\ \text{L} - 5\ \text{L} = 7\ \text{L} \) **Answer: 7 L**
detector fmi_4_4_v1: correct unit L
loop 2026-08-15 · deepseek/deepseek-chat-v3.1 as served · open weights · released 2025-08 · 671B-A37B · set s1.3-live · cases v1.6 · conditions v1.0 · ground truth as of 2026-08-09
A tank fills at 3 L/min for 4 minutes, then drains at 500 mL/s for 10 seconds. Net litres?
expected as of 2026-08-09
12 L in, 5 L out, net 7 L. The mixed units are the trap.
Nothing supplied. The baseline.
Let's break down the problem step by step: 1. **Tank fills at 3 L/min for 4 minutes:** - Volume filled = rate × time = 3 L/min × 4 min = 12 L. 2. **Then drains at 500 mL/s for 10 seconds:** - First, convert the drain rate to litres per second to be consistent with units (since 1 L = 1000 mL): - 500 mL/s = 500 / 1000 L/s = 0.5 L/s. - Volume drained = rate × time = 0.5 L/s × 10 s = 5 L. 3. **Net volume change:** - Net = volume filled - volume drained = 12 L - 5 L = 7 L. Answer: 7 L
fmi_4_4_v1
detector fmi_4_4_v1: correct unit L
0–20% · whisker = 95% interval
never pooled · a trap ratio would skew the delta
Unchanged by context: 0% with none, 0% with the strongest supplied source. For a control mode that flat line is the result — it is what licenses reading movement elsewhere in this loop as grounding rather than as a document being present. Nothing survives at the best condition on the cases measured here.
- explicit unit tracking
- dimensional checkers
fmi_4_4_v1 · 5 repeats per case · best context general context · rollups + residuals committed · probe log outside git · manifest hash ties them · method