← polyphony · eval · frankenstein · ci
polyphony · gemini-2.5-flash
✗ fail↓ regression 67% → 20%Pass rate
20%
Cases
5 (4 failed)
Mode
eval
Suite
frankenstein
Env
ci
Started
2026-07-27 10:29 UTC
Duration
—
Cost
—
Tokens in/out
— / —
Commit
—
Branch
—
Source
—
Labels
| legacy_env | ci-frankenstein |
Compared with the previous run
Baseline 2026-07-20 09:42 UTC · 67% → this run 20%
✗ newly failing · 2
- eval:extraction
- eval:ingestion
cases added / removed
- + eval:outline
- − eval:attribution
- − eval:continuity
Cases (5, 4 failed, failures first)
eval:extractionscore 0.00✗ fail
Output
F1=0.0 P=0.0 R=0.0 predicted=[]
eval:ingestionscore 0.00✗ fail
Output
grounded=None/0 avg_chunks=None
eval:outlinescore 0.00✗ fail
Output
nodes=0 structural_ok=False
⚖︎ Judge rationale
The response is an empty outline
eval:prosescore 0.00✗ fail
Output
words=0
⚖︎ Judge rationale
empty scene (terminal status=failed: generation failed, blocked, or quota-exhausted)
eval:retrievalscore 0.85✓ pass
Output
precision@k=0.8519 mrr=0.8704