Written by Jakub Rusinowski · Last updated September 8, 2026
Model library → Nex-N2.5 → Nex-N2.5 mini
The only Nex model a consumer card holds at all: 21.9 GB of weights at Q4_K_M, 23.8 GB once an 8K KV cache is added — tight on a 24 GB 4090, comfortable on a 32 GB 5090. Reads 3B parameters per token, which is why a 35B model decodes at small-model speed. Scores 73.4 on Terminal-Bench 2.1 and 83.4 on BrowseComp — the latter within 10 points of the 1.6T Max. Parameter counts are inherited from the Nex-N2 base rather than published for N2.5 directly.
Nex-N2.5 mini needs about 22 GB of VRAM at Q4_K_M — quantized weights plus framework overhead, before any KV cache. On Apple Silicon that figure comes out of unified memory.
| Parameters | 35 Billion (3B active) |
| Context window | 262,144 |
| Architecture | Mixture-of-Experts (Qwen3.5-35B-A3B base, multimodal) |
| Provider | Nex-AGI |
| Licence | Open-weight (terms unpublished) |
| Specified at | Q4_K_M |
| System RAM | 32 GB |
| Record updated | 2026-09-08 |
Custom Open-Weight — commercial use permitted. Weights are downloadable and commercial use is permitted, subject to the licence’s acceptable-use terms.
Modelled on a reference NVIDIA RTX 4090 (24 GB), with no KV cache (this record has no published architecture). Speed figures are ESTIMATES from the memory-bandwidth roofline described on the methodology page, not benchmarks we ran — rows marked measured come from published or reader-submitted runs. VRAM here includes the KV cache, so it reads higher than the headline figure above, which does not.
| Quant | Weights | VRAM needed | Est. speed | Fit on 24 GB |
|---|---|---|---|---|
| Q2_K | 11.5 GB | 12.3 GB | ~209 tok/s (est.) | Fits comfortably |
| Q3_K_M | 14.9 GB | 15.7 GB | ~193 tok/s (est.) | Fits comfortably |
| Q4_K_M | 21.1 GB | 21.9 GB | ~170 tok/s (est.) | Tight fit |
| Q5_K_M | 24.8 GB | 25.6 GB | ~24 tok/s (est.) | Offloads to system RAM (slow) |
| Q6_K | 28.7 GB | 29.5 GB | ~22 tok/s (est.) | Offloads to system RAM (slow) |
| Q8_0 | 37.2 GB | 38.0 GB | ~19 tok/s (est.) | Offloads to system RAM (slow) |
| F16 | 70.0 GB | 70.8 GB | — | Won't fit |
Want the memory numbers alone, at every quantization level and your own context length? Use the Nex-N2.5 mini VRAM calculator.
or compare on Vast.ai from $0.35/hr (typical low · varies)
As an Amazon Associate we earn from qualifying purchases. Cloud GPU links are referral links — we may earn a commission at no extra cost to you.
The cheapest catalogued GPU that runs Nex-N2.5 mini is the AMD Radeon RX 7900 XTX (24 GB).
Install Ollama, then run:
ollama run nex-n2-5Weights on Hugging Face: nex-agi/Nex-N2.5-mini.
Best for: agentic tasks, coding, consumer gpu, multimodal.
← All Nex-N2.5 models | VRAM calculator | Check your own hardware