Public GPU and NPU uploads
AMD RX 9070 XT
4096 Stream Processors
Type
GPU
VRAM
16 GB
Memory bandwidth
640 GB/s
TDP
304 W
Benchmark results
|
Llama 2
7B
|
Q4_0 | 512 | 5,036.04 | 102.00 ms | 137 | llama.cpp | Vulkan | — | uploaded 4 weeks ago |
|
|
Standardized test
Llama-Bench
Used prompt
llama-bench -p 512 -n 128
Notes
llama-bench / Vulkan scoreboard; Flash Attention deaktiviert
Evidence
|
||||||||||