Public GPU and NPU uploads

AMD RX 7900 XT

5376 Stream Processors

Type

GPU

VRAM

20 GB

Memory bandwidth

800 GB/s

TDP

315 W

Benchmark results

Llama 2 7B
Q4_0 512 2,941.58 174.00 ms 123 llama.cpp Vulkan uploaded 4 weeks ago
AI Hardware Research System
Standardized test

Llama-Bench

Used prompt

llama-bench -p 512 -n 128

Notes

llama-bench / Vulkan scoreboard; Flash Attention deaktiviert