// VRAM Calculator
Weights
KV cache
Engine overhead
Recommended VRAM
Mode
⚠
// loading gpu data...
| GPU | VRAM | BW GB/s | Decode tok/s | Ecosystem | Price | $/GB | $/GB/s | Thermal |
|---|---|---|---|---|---|---|---|---|
|
Modded
Counterfeit risk
Linux preferred
No FP16
|
|
|||||||