Public GPU and NPU uploads
AMD RX 7900 XT
5376 Stream Processors
Type
GPU
VRAM
20 GB
Memory bandwidth
800 GB/s
TDP
315 W
Benchmark results
|
Llama 2
7B
|
Q4_0 | 512 | 2,941.58 | 174.00 ms | 123 | llama.cpp | Vulkan | — | uploaded 4 weeks ago |
|
|
Standardized test
Llama-Bench
Used prompt
llama-bench -p 512 -n 128
Notes
llama-bench / Vulkan scoreboard; Flash Attention deaktiviert
Evidence
|
||||||||||