Every GPU and what it can do.
Memory bandwidth sets each card's ceiling; the board shows who gets close.
Memory bandwidth sets each card's ceiling; the board shows who gets close.
Cards with results come first. The ceiling is theoretical: bandwidth divided by the 3.4 GB that Qwen3.8 Flash-Next Q4_K_M reads per token.
| GPU | Bandwidth | Rigs | Best generation | Typical share of ceiling | Ceiling, Qwen3.8 Flash-Next Q4_K_M |
|---|---|---|---|---|---|
| Instinct MI300X | 5,300 GB/s | 0 | No runs | 1,543tok/s max | |
| RX 7900 XTX | 960 GB/s | 0 | No runs | 279tok/s max | |
| RX 7900 XT | 800 GB/s | 0 | No runs | 233tok/s max | |
| Ryzen AI Max+ 395 | 256 GB/s | 0 | No runs | 74.5tok/s max |