← Leaderboard LLM run · e2c4db5d-caa9-4812-99bc-607fabd0be1b

Qwen3.8-27B-GGUF-UD-Q4_K_XL

Intel(R) Xeon(R) Silver 4314 CPU @ 2.40GHz · profile NVIDIA-L4

LLMUD-Q4_K_XLdensecpullamacpp-cpuvalid 2026-08-24 19:53 UTC
3.6
Decode tok/s ↑
± 0.443 (95% CI) · sd 0.357
115
Prefill tok/s ↑ (cache-assisted)
± 6.4 (95% CI) · sd 5.15
686
TTFT ms ↓ (cache-assisted)
± 38.4 (95% CI)
274.2
Inter-token ms ↓
108.7
Peak memory GB
5
Trials

Validity: valid

The checks LemonMatrix ran while measuring; an invalid run is shown but never ranked.

Trials

Each measured trial after warm-up, from the run's trial sidecar. The summary above is computed from these.

#ttft msdecode tokens per secprompt tokensoutput tokenshost memory gbdecode tokens per sec
1686.53.92479158107.2
2698.84.12379133107.8
3649.23.31479153108
46663.37479160108.3
5729.63.50379173108.7

Same model, other runs

Every run of Qwen3.8-27B-GGUF-UD-Q4_K_XL · UD-Q4_K_XL on the board, ranked by decode tok/s. This run is highlighted.

ProfileDeviceEngineBackend decode tok/s ↑Valid
AMD-Instinct-MI350Xgfx950 GPUdgpullamacpp-rocm100.01
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-vulkan20.48
valid
Radeon-RX-7900-XTX-WSLAMD Radeon RX 7900 XTX (gfx1100)dgpullamacpp-rocm17.10
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-rocm14.19
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-vulkan9.83
invalid
NVIDIA-L4Intel(R) Xeon(R) Silver 4314 CPU @ 2.40GHzcpullamacpp-cpu3.65
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-rocm2.50
invalid

Model and configuration

model.nameQwen3.8-27B-GGUF-UD-Q4_K_XL
model.classdense
model.quantizationUD-Q4_K_XL
model.context_length4096
config.compute_enginecpu
config.backendllamacpp-cpu
config.oslinux
config.power_stateplugged

Environment

cpuIntel(R) Xeon(R) Silver 4314 CPU @ 2.40GHz
device_modelIntel(R) Xeon(R) Silver 4314 CPU @ 2.40GHz
dgpu7x NVIDIA L4
dgpu_family7x sm_89
driver_version535.309.01
lemonade_version11.6.0
memory_gb251.5
os_versionLinux-6.8.0-117-generic (Ubuntu 22.04)
backend_versionb10375

All metrics

prefill.tokens_per_sec115.2
prefill.stddev5.152
prefill.p95121.1
prefill.ci95_half_width6.396
decode.tokens_per_sec3.647
decode.inter_token_latency_ms274.2
decode.stddev0.3571
decode.p954.084
decode.ci95_half_width0.4433
ttft_ms686
trial_count5
peak_memory_gb108.7
prompt_sha2561c43b07d6b0d7624785966ffe2ddc076aa76b5fcf9357882ac1165f0073f43ee
ttft_ms_stddev30.9
ttft_ms_ci95_half_width38.36