← Leaderboard LLM run · 516e293f-6bc6-4b69-a3ef-c20fdf21e9a6

Qwen3.8-27B-GGUF-UD-Q4_K_XL

gfx950 GPU · profile AMD-Instinct-MI350X

LLMUD-Q4_K_XLdensedgpullamacpp-rocmvalid 2026-08-24 19:52 UTC
100.0
Decode tok/s ↑
± 7.2 (95% CI) · sd 5.8
842
Prefill tok/s ↑ (cache-assisted)
± 54.7 (95% CI) · sd 44
94
TTFT ms ↓ (cache-assisted)
± 6.09 (95% CI)
10.0
Inter-token ms ↓
20.6
Peak memory GB
5
Trials

Validity: valid

The checks LemonMatrix ran while measuring; an invalid run is shown but never ranked.

Trials

Each measured trial after warm-up, from the run's trial sidecar. The summary above is computed from these.

#ttft msdecode tokens per secprompt tokensoutput tokensvram gbhost memory gbdecode tokens per sec
193.59103.47915420.6216.8
299.78102.37914920.6217.4
397.5389.957915820.6317.9
488.42104.17924920.6318.4
589.6100.37915420.6319

Same model, other runs

Every run of Qwen3.8-27B-GGUF-UD-Q4_K_XL · UD-Q4_K_XL on the board, ranked by decode tok/s. This run is highlighted.

ProfileDeviceEngineBackend decode tok/s ↑Valid
AMD-Instinct-MI350Xgfx950 GPUdgpullamacpp-rocm100.01
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-vulkan20.48
valid
Radeon-RX-7900-XTX-WSLAMD Radeon RX 7900 XTX (gfx1100)dgpullamacpp-rocm17.10
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-rocm14.19
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-vulkan9.83
invalid
NVIDIA-L4Intel(R) Xeon(R) Silver 4314 CPU @ 2.40GHzcpullamacpp-cpu3.65
valid
Radeon-RX-7900-XTXAMD Radeon RX 7900 XTXdgpullamacpp-rocm2.50
invalid

Model and configuration

model.nameQwen3.8-27B-GGUF-UD-Q4_K_XL
model.classdense
model.quantizationUD-Q4_K_XL
model.context_length4096
config.compute_enginedgpu
config.backendllamacpp-rocm
config.oslinux
config.power_stateplugged

Environment

cpuAMD EPYC 9575F 64-Core Processor
device_modelAMD EPYC 9575F 64-Core Processor
dgpu90500
dgpu_familygfx950
driver_versionunknown
lemonade_version11.7.0
memory_gb251.7
os_versionLinux-6.8.0-124-generic (Ubuntu 24.04)
backend_versionb10470

All metrics

prefill.tokens_per_sec842.4
prefill.stddev44.04
prefill.p95891.1
prefill.ci95_half_width54.67
decode.tokens_per_sec100
decode.inter_token_latency_ms9.999
decode.stddev5.802
decode.p95103.9
decode.ci95_half_width7.202
ttft_ms93.78
trial_count5
peak_memory_gb20.63
prompt_sha2561c43b07d6b0d7624785966ffe2ddc076aa76b5fcf9357882ac1165f0073f43ee
ttft_ms_stddev4.907
ttft_ms_ci95_half_width6.092