Home / Evidence

Evidence ledger

Rules first, data second, and failures published next to passes.

WorkloadRoute and testAnswersCostVerdict
Support triageLuna answers first, Sol takes low-confidence cases (selection, 400 held-out)391 vs 390−95.9%selected
Support triageSame route on 148 fresh cases142 vs 141, 0 worse−97.4%confirmed
Support triageThrough the real gateway1 worse, 2 better−97.8%confirmed
Support triageGuarded cloud run with an independent meter31 of 31 correct in both arms−95.2%pass
BANKING77 intentsCheapest route matching GPT-6 Sol on 400 fresh messages16 worse, 15 better−98.0%not confirmed
BANKING77 intentsCheapest route matching Gemini 3.8 Flash on 400 fresh messages21 worse, 16 better−97.8%not confirmed
BANKING77 intentsCheapest route matching Claude Opus 5.5 (selection)354 vs 354, 259 of 400 escalated−31.9%selected

Support triage benchmark · BANKING77 intent benchmark