polyphony · gemini-2.5-flash

Mode

eval

Env

ci-dracula

Pass rate

71%

Result

fail

Duration

—

Cost

—

Tokens in/out

— / —

Git SHA

Started

2026-07-16 07:27

Cases (7, failures first)

eval:attributionscore 0.17fail

Output

score=0.1666 ±0.1666 (n=2)  accuracy=0.0 chance=0.3333 n=3

eval:prosescore 0.45fail

Output

score=0.45 ±0.45 (n=2)  words=0

⚖︎ Judge rationale

empty scene (terminal status=failed: generation failed, blocked, or quota-exhausted)

eval:continuityscore 0.75pass

Output

score=0.75 ±0.25 (n=2)  detection_recall=1.0 fpr=1.0

eval:extractionscore 0.71pass

Output

score=0.7059 ±0.0 (n=2)  F1=0.7059 P=0.6 R=0.8571 predicted=['Aldous Kerr', 'Nora', 'Percy', 'Mr. Boone', 'Cora', 'Sister Agatha', 'Dr. Ward', 'Renwick', 'Verhoeven', 'Elias']

eval:ingestionscore 0.90pass

Output

score=0.9 ±0.0 (n=2)  grounded=9/10 avg_chunks=21.5

eval:outlinescore 0.80pass

Output

score=0.8 ±0.0 (n=2)  nodes=6 structural_ok=True

⚖︎ Judge rationale

recovered score from unstructured reply

eval:retrievalscore 0.82pass

Output

score=0.8182 ±0.0 (n=2)  precision@k=0.8182 mrr=0.9545