One verify pass keeps the drafts up to the first rejection, plus one token
Top: a proposer drafts three tokens, the target model checks them in one pass, keeps the first two, rejects the third, and adds its own token. Bottom: one real request with Qwen3-8B on our L4 and EAGLE3 with three drafts per step wrote 12 tokens. One came from prefill and 11 from 6 verify passes, which kept 5 of 18 drafts.
THE RULE, BY POSITION
draft 1
draft 2
draft 3
kept
kept
rejected
target token
One target pass writes the kept drafts and one token of its own.
ONE REAL REQUEST: QWEN3-8B ON OUR L4, EAGLE3, 3 DRAFTS
Paris
12095
.
13
The
576
capital
6722
of
315
Italy
15344
is
374
Rome
21718
.
13
The
576
capital
6722
of
315
Token 1 came from prefill. The other 11 came from 6 verify passes.
Drafts kept per pass: 0 in 3 passes, 1 in 2 passes, 3 in 1 pass.
So 5 of 18 drafts were kept, about 1.8 tokens per pass.