Public GPU and NPU uploads
AMD RX 6800 XT
4608 Stream Processors
Type
GPU
VRAM
16 GB
Memory bandwidth
512 GB/s
TDP
300 W
Benchmark results
|
Llama 2
7B
|
Q4_0 | 512 | 1,752.92 | 292.00 ms | 100 | llama.cpp | Vulkan | — | uploaded 4 weeks ago |
|
|
Standardized test
Llama-Bench
Used prompt
llama-bench -p 512 -n 128
Notes
llama-bench / Vulkan scoreboard; Flash Attention deaktiviert
Evidence
|
||||||||||