← polyphony · eval · dracula · ci
polyphony · gemini-2.5-flash
✗ failPass rate
71%
Cases
7 (2 failed)
Mode
eval
Suite
dracula
Env
ci
Started
2026-07-16 07:27 UTC
Duration
—
Cost
—
Tokens in/out
— / —
Commit
—
Branch
—
Source
—
Labels
| legacy_env | ci-dracula |
Compared with the previous run
Baseline 2026-07-15 07:32 UTC · 50% → this run 71%
± score moved · 1
- eval:continuity: 1.00 → 0.75
cases added / removed
- + eval:extraction
- + eval:ingestion
- + eval:outline
Cases (7, 2 failed, failures first)
eval:attributionscore 0.17✗ fail
Output
score=0.1666 ±0.1666 (n=2) accuracy=0.0 chance=0.3333 n=3
eval:prosescore 0.45✗ fail
Output
score=0.45 ±0.45 (n=2) words=0
⚖︎ Judge rationale
empty scene (terminal status=failed: generation failed, blocked, or quota-exhausted)
eval:continuityscore 0.75✓ pass
Output
score=0.75 ±0.25 (n=2) detection_recall=1.0 fpr=1.0
eval:extractionscore 0.71✓ pass
Output
score=0.7059 ±0.0 (n=2) F1=0.7059 P=0.6 R=0.8571 predicted=['Aldous Kerr', 'Nora', 'Percy', 'Mr. Boone', 'Cora', 'Sister Agatha', 'Dr. Ward', 'Renwick', 'Verhoeven', 'Elias']
eval:ingestionscore 0.90✓ pass
Output
score=0.9 ±0.0 (n=2) grounded=9/10 avg_chunks=21.5
eval:outlinescore 0.80✓ pass
Output
score=0.8 ±0.0 (n=2) nodes=6 structural_ok=True
⚖︎ Judge rationale
recovered score from unstructured reply
eval:retrievalscore 0.82✓ pass
Output
score=0.8182 ±0.0 (n=2) precision@k=0.8182 mrr=0.9545