On the L4 the two engines wrote the same tokens per second up to 32 users
Output tokens per second against users at the same time on an NVIDIA L4 with Qwen3-8B, the same 24,096-token KV pool, three seeds per point. The two lines are within 3 percent up to 32 users. At 64 users SGLang wrote 256.6 and vLLM 241.4 tokens per second.
0
100
200
300
1
2
4
8
16
32
64
users at the same time
output tokens per second
vLLM 0.31.0
SGLang 0.5.22