The same tokens in three orders Three token ribbons for prompts of about 3,000 tokens. The stable prompt reuses 2,998 tokens and computes 1, with a median first-token time of 45 ms. With a random ID at the start, only 5 tokens are reused and about 3,029 are computed, at 1,255 ms. With the same ID at the end, 2,985 tokens are reused and about 45 are computed, at 88 ms. reused from the radix cache computed in prefill STABLE SYSTEM PROMPT 2,998 cached median TTFT 45 ms RANDOM ID AT THE START 5 cached median TTFT 1,255 ms RANDOM ID AT THE END 2,985 cached median TTFT 88 ms Every token after the first difference is a new branch of the tree.