polyphony · gemini-3.6-flash

✗ fail

Pass rate

75%

Cases

4 (1 failed)

Mode

eval

Suite

dracula

Env

Started

2026-10-19 14:00 UTC

Duration

—

Cost

—

Tokens in/out

— / —

Commit

e954eae

Branch

—

Source

—

Labels

legacy_env	ci-dracula

Compared with the previous run

No earlier complete run in this series (polyphony · eval · dracula · ci · gemini-3.6-flash), so there is no baseline yet.

Cases (4, 1 failed, failures first)

eval:outlinescore 0.00✗ fail

Output

nodes=0 structural_ok=False

⚖︎ Judge rationale

R1: The outline contains no characters, so principal cast members are missing, meeting the rubric's 0.4 level for missing or reduced principals. | R6: The outline is empty, providing no structure or alignment with the premise. | R3: No beats are present as the outline is empty, so the text does not follow any plan.

eval:extractionscore 0.58✓ pass

Output

F1=0.5833 P=0.4118 R=1.0 predicted=['Cora Ellis', 'Percy Alderton', 'Dr. Elias Ward', 'Van Verhoeven', 'Aldous Kerr', 'Peter Falk', 'Mrs. Ellis', 'R. M. Renwick', 'Nora Vance', 'Cassidy P. Boone', 'Count Vasska', 'Lucy Ellis', 'Sister Agatha', 'Minna Vance', 'Mr. Swales', 'Vanderpool', 'Winifred Vance']

eval:ingestionscore 0.69✓ pass

Output

grounded=11/16 avg_chunks=16.12

eval:retrievalscore 0.82✓ pass

Output

precision@k=0.8182 mrr=0.9545