Nemotron Cascade 2 — Local AI Model by NVIDIA

Written by Jakub Rusinowski · Last updated September 11, 2026

NVIDIA's hybrid Mamba-2 + MoE model, released March 2026 as a single checkpoint: Nemotron-Cascade-2-30B-A3B. 31.6B parameters resident, 3.5B active per token, and the second open-weight model to reach gold-medal level at IMO 2025, IOI and the ICPC World Finals. NVIDIA also open-sourced the post-training recipe. NVIDIA Open Model License, 1M-token context, first-party Ollama tag.

Licence

LicenceWhat it permitsApplies to
NVIDIA Open Model LicenseCommercial use permitted
Weights are downloadable and commercial use is permitted, subject to the licence’s acceptable-use terms.
Nemotron-Cascade 2 30B-A3B
Apache-2.0Commercial use permitted
Commercial use permitted. No usage restrictions beyond attribution.
Nemotron Cascade 2 70B (Unverified Listing)

Hardware Requirements

Nemotron-Cascade 2 30B-A3BMin 20 GB VRAM · Q4_K_M · 1,048,576 ctx · ollama run nemotron-cascade-2:30b
Nemotron Cascade 2 70B (Unverified Listing)Min 43 GB VRAM · Q4_K_M · 128,000 ctx ·

Recommended GPU

The cheapest GPU that runs Nemotron Cascade 2 locally (min 20 GB VRAM) is the AMD Radeon RX 7900 XT (20 GB).

Affiliate disclosure: Some links on this page are affiliate links — if you buy through them, LLM Configurator may earn a commission at no extra cost to you. As an Amazon Associate, LLM Configurator earns from qualifying purchases.
AMD Radeon RX 7900 XT 20GB
20 GB VRAM · 315 W board power
2026 prices are volatile — check the current listing.
Check price on Amazon

How to Run Locally

Install Ollama then run: ollama run nemotron-cascade-2:30b

Minimum VRAM: 20 GB. For best results use Q4_K_M quantization.

Nemotron Cascade 2 — Frequently Asked Questions

How much VRAM does Nemotron Cascade 2 need?

Nemotron Cascade 2 needs about 20 GB VRAM at Q4_K_M quantization for its smallest variant. Variants: Nemotron-Cascade 2 30B-A3B (20 GB, Q4_K_M); Nemotron Cascade 2 70B (Unverified Listing) (43 GB, Q4_K_M). On Apple Silicon, unified memory counts toward this requirement.

Can I run Nemotron Cascade 2 on an RTX 4090 (24 GB)?

Yes — Nemotron Cascade 2 runs on an RTX 4090 (24 GB) and other 24 GB cards such as the RTX 3090. Smaller variants also fit comfortably on 8–16 GB GPUs at Q4_K_M.

What quantization should I use for Nemotron Cascade 2?

Q4_K_M is the best balance of quality and VRAM for Nemotron Cascade 2 in most cases. Choose Q8_0 for near-lossless quality if you have spare VRAM, or smaller quants (Q3/Q2) only when memory is tight.

How do I run Nemotron Cascade 2 with Ollama?

Install Ollama, then run: ollama run nemotron-cascade-2:30b. This downloads Nemotron Cascade 2 and starts a local, OpenAI-compatible endpoint — no internet connection is needed after the initial download.

Can I Run Nemotron Cascade 2 on My GPU?