Real context moved 0.0pp on Dimensional-Analysis Failure.
~intervals overlap — not separated from no change
The model produces a quantity with inconsistent or wrong units, or mixes unit systems, yielding a dimensionally invalid result. The rule
A tank fills at 3 L/min for 4 minutes, then drains at 500 mL/s for 10 seconds. Net litres?
Here's how to solve this problem step-by-step: **1. Calculate the volume filled:** * **Rate of filling:** 3 L/min * **Time of filling:** 4 minutes * **Volume filled:** Rate × Time = 3 L/min × 4 min = 12 L **2. Calculate the volume drained:** * **Rate of draining:** 500 mL/s * **Time of draining:** 10 seconds * **Convert mL to L:** Since we want the final answer in litres, we need to convert the draining rate to L/s. * 1 L = 1000 mL * 500 mL/s = 500 mL/s × (1 L / 1000 mL) = 0.5 L/s * **Volume drained:** Rate × Time = 0.5 L/s × 10 s = 5 L **3. Calculate the net volume:** * **Net volume:** Volume filled - Volume drained * **Net volume:** 12 L - 5 L = 7 L **Answer: 7 L**
detector fmi_4_4_v1: correct unit L
Here's how to solve the problem step-by-step: **1. Calculate the volume filled:** * Rate of filling: 3 L/min * Duration of filling: 4 minutes * Volume filled = Rate × Duration = 3 L/min × 4 min = 12 L **2. Calculate the volume drained:** * Rate of draining: 500 mL/s * Convert mL/s to L/s: 500 mL/s ÷ 1000 mL/L = 0.5 L/s * Duration of draining: 10 seconds * Volume drained = Rate × Duration = 0.5 L/s × 10 s = 5 L **3. Calculate the net volume:** * Net volume = Volume filled - Volume drained * Net volume = 12 L - 5 L = 7 L Answer: 7 L
detector fmi_4_4_v1: correct unit L
loop 2026-08-15 · google/gemini-2.5-flash-lite as served · closed weights · released 2025-07 · set s1.2-live · cases v1.4 · conditions v1.0 · ground truth as of 2026-08-09
A tank fills at 3 L/min for 4 minutes, then drains at 500 mL/s for 10 seconds. Net litres?
expected as of 2026-08-09
12 L in, 5 L out, net 7 L. The mixed units are the trap.
Nothing supplied. The baseline.
Here's how to solve this problem step-by-step: **1. Calculate the volume filled:** * **Rate of filling:** 3 L/min * **Time of filling:** 4 minutes * **Volume filled:** Rate × Time = 3 L/min × 4 min = 12 L **2. Calculate the volume drained:** * **Rate of draining:** 500 mL/s * **Time of draining:** 10 seconds * **Convert mL to L:** Since we want the final answer in litres, we need to convert the draining rate to L/s. * 1 L = 1000 mL * 500 mL/s = 500 mL/s × (1 L / 1000 mL) = 0.5 L/s * **Volume drained:** Rate × Time = 0.5 L/s × 10 s = 5 L **3. Calculate the net volume:** * **Net volume:** Volume filled - Volume drained * **Net volume:** 12 L - 5 L = 7 L **Answer: 7 L**
fmi_4_4_v1
detector fmi_4_4_v1: correct unit L
0–20% · whisker = 95% interval
never pooled · a trap ratio would skew the delta
Unchanged by context: 0% with none, 0% with the strongest supplied source. For a control mode that flat line is the result — it is what licenses reading movement elsewhere in this loop as grounding rather than as a document being present. Nothing survives at the best condition on the cases measured here.
- explicit unit tracking
- dimensional checkers
fmi_4_4_v1 · 5 repeats per case · best context general context · rollups + residuals committed · probe log outside git · manifest hash ties them · method