polyphony · gemini-2.5-flash

Mode

eval

Env

ci-frankenstein

Pass rate

20%

Result

fail

Duration

—

Cost

—

Tokens in/out

— / —

Git SHA

Started

2026-07-27 10:29

Cases (5, failures first)

eval:extractionscore 0.00fail

Output

F1=0.0 P=0.0 R=0.0 predicted=[]

eval:ingestionscore 0.00fail

Output

grounded=None/0 avg_chunks=None

eval:outlinescore 0.00fail

Output

nodes=0 structural_ok=False

⚖︎ Judge rationale

The response is an empty outline

eval:prosescore 0.00fail

Output

words=0

⚖︎ Judge rationale

empty scene (terminal status=failed: generation failed, blocked, or quota-exhausted)

eval:retrievalscore 0.85pass

Output

precision@k=0.8519 mrr=0.8704