polyphony · gemini-2.5-flash

Mode

eval

Env

ci-frankenstein

Pass rate

67%

Result

fail

Duration

—

Cost

—

Tokens in/out

— / —

Git SHA

Started

2026-07-14 02:33

Cases (3, failures first)

eval:ingestionscore 0.00fail

Output

grounded=None/0 avg_chunks=None

eval:extractionscore 0.59pass

Output

F1=0.5882 P=0.5 R=0.7143 predicted=['Mrs. Sarrow', 'Isolde', 'Uncle Thomas', 'Hollis Crane', 'Vandel', 'Cosima', 'Alina', 'Fenwick', 'The Creature', 'The Stranger']

eval:retrievalscore 0.85pass

Output

precision@k=0.8519 mrr=0.8704