← polyphony · eval · frankenstein · ci
polyphony · gemini-2.5-flash
✗ fail↓ regression 50% → 25%Pass rate
25%
Cases
4 (3 failed)
Mode
eval
Suite
frankenstein
Env
ci
Started
2026-08-17 07:32 UTC
Duration
—
Cost
—
Tokens in/out
— / —
Commit
—
Branch
—
Source
—
Labels
| legacy_env | ci-frankenstein |
Compared with the previous run
Baseline 2026-08-10 08:20 UTC · 50% → this run 25%
cases added / removed
- + eval:outline
- − eval:continuity
Cases (4, 3 failed, failures first)
eval:extractionscore 0.00✗ fail
Output
F1=0.0 P=0.0 R=0.0 predicted=[]
eval:ingestionscore 0.00✗ fail
Output
grounded=None/0 avg_chunks=None
eval:outlinescore 0.00✗ fail
Output
nodes=0 structural_ok=False
⚖︎ Judge rationale
The response is an empty outline
eval:retrievalscore 0.85✓ pass
Output
precision@k=0.8519 mrr=0.8704