polyphony · gemini-2.5-flash

✗ fail↓ regression 100% → 67%

Pass rate

67%

Cases

3 (1 failed)

Mode

eval

Suite

frankenstein

Env

Started

2026-07-14 02:33 UTC

Duration

—

Cost

—

Tokens in/out

— / —

Commit

—

Branch

—

Source

—

Labels

legacy_env	ci-frankenstein

Compared with the previous run

Baseline 2026-07-13 04:36 UTC · 100% → this run 67%

cases added / removed

+ eval:extraction
+ eval:ingestion

Cases (3, 1 failed, failures first)

eval:ingestionscore 0.00✗ fail

Output

grounded=None/0 avg_chunks=None

eval:extractionscore 0.59✓ pass

Output

F1=0.5882 P=0.5 R=0.7143 predicted=['Mrs. Sarrow', 'Isolde', 'Uncle Thomas', 'Hollis Crane', 'Vandel', 'Cosima', 'Alina', 'Fenwick', 'The Creature', 'The Stranger']

eval:retrievalscore 0.85✓ pass

Output

precision@k=0.8519 mrr=0.8704