Written by Jakub Rusinowski · Last updated July 12, 2026
Same GB206 chip and 448 GB/s bandwidth as the 16GB variant, but 8 GB VRAM limits it to 7–8B models in Q4. The cheaper of the two RTX 5060 Ti configurations.
| VRAM | 8 GB |
| Memory Bandwidth | 448 GB/s |
| TDP | 180 W |
| Architecture | Blackwell GB206 |
| Release Year | 2025 |
| MSRP at Launch | $379 |
| Inference Speed (Llama 3.1 8B Q4_K_M) | 40–83 tok/s (estimated) |
| Inference Speed (Llama 3.3 70B Q4_K_M) | Does not fit — needs ~44 GB of 8 GB usable |
or compare on Vast.ai from $0.35/hr (typical low · varies)
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
All models below run comfortably in 8 GB VRAM with Q4_K_M quantization.
| Llama 3.1 Family | Llama 3.1 8B Instruct · 6 GB VRAM · Q4_K_M · ollama run llama3.1 |
| Llama 3.2 Family | Llama 3.2 11B Vision Instruct · 7 GB VRAM · Q4_K_M · llama-3-2 |
| Qwen 2.5 Family | Qwen 2.5 7B Instruct · 5 GB VRAM · Q4_K_M · ollama run qwen2.5:7b |
| Gemma 3 | Gemma 3 4B Instruct · 3 GB VRAM · Q4_K_M · ollama run gemma3:4b |
| Phi-4 Mini | Phi-4 Mini (3.8B) · 3 GB VRAM · Q4_K_M · ollama run phi4-mini |
| SmolLM2 | SmolLM2 1.7B Instruct · 2 GB VRAM · Q4_K_M · ollama run smollm2:1.7b |
| Ministral 3 | Ministral 3 8B · 6 GB VRAM · Q4_K_M · ollama run ministral-3:8b |
| IBM Granite 4.2 | Granite 4.2 8B · 6 GB VRAM · Q4_K_M · ollama run granite4.2:8b |
Install Ollama then run the recommended model for this GPU:
ollama run llama3.1:8b
Yes — the NVIDIA GeForce RTX 5060 Ti 8GB has 8 GB VRAM and runs Same GB206 chip and 448 GB/s bandwidth as the 16GB variant, but 8 GB VRAM limits it to 7–8B models in Q4. The cheaper of
The NVIDIA GeForce RTX 5060 Ti 8GB is estimated to run Llama 3.1 8B at 40–83 tok/s with Q4_K_M quantization. Llama 3.3 70B does not fit: it needs about 44 GB against 8 GB usable. These are modelled estimates, not measurements — see /en/methodology.
With 8 GB you can run: Llama 3.1 Family, Llama 3.2 Family, Qwen 2.5 Family, Gemma 3, Phi-4 Mini. Use Ollama for the easiest setup: ollama run llama3.1:8b.
← All GPU Reviews | All Hardware | Check Your Hardware | Full Benchmarks | Can I Run It?