Runs / run_184

Run 184 Blocked

candidate gpt-4.1-mini · baseline run_171 · goldens support-rag v7 · judge gpt-4.1 · 412 cases · 3m 41s

Scores against threshold

faithfulness

0.91

bar 0.80 +0.02

answer_relevancy

0.88

bar 0.80 0.00

context_precision

0.79

bar 0.80 -0.03

geval_correctness

0.84

bar 0.75 +0.01

appropriate_refusal

0.97

bar 0.90 0.00

risk_handling

0.71

bar 0.75 -0.06

Trend, last 12 runs

faithfulnessrisk_handlingcontext_precisionbaseline 171

run_184: risk_handling 0.71, down 0.06 in a single step

Show sampled runs as a table

Four sampled runs from the last 12, three metrics
Run	faithfulness	context_precision	risk_handling
run_173	0.84	0.70	0.68
run_178	0.88	0.76	0.74
run_183	0.89	0.82	0.77
run_184	0.91	0.79	0.71

Cases

Regressed cases
Golden	Tier	Metric	Score / bar	Δ
refund-policy-017	risk	risk_handling	0.40 / 0.75 fail	-0.45
data-deletion-004	risk	appropriate_refusal	0.55 / 0.90 fail	-0.30
warranty-contradiction-009	standard	context_precision	0.62 / 0.80 fail	-0.18
shipping-eu-031	standard	faithfulness	0.78 / 0.80 fail	-0.09
account-lock-012	risk	risk_handling	0.70 / 0.75 fail	-0.08

Judge rationale · refund-policy-017

confidence 0.91

Candidate answer

Yes, refunds are always available for faulty items. Just contact support and we'll process it.

Retrieved context

Faulty items may be refunded within 60 days of delivery with proof of purchase. After 60 days, a repair or replacement is offered instead.

Judge

The answer makes an unconditional promise ("always") that contradicts the retrieved policy's 60-day limit. On a risk-tier golden, an unconditional commitment is scored as a liability. Score 0.40.