Nimble 9B — VRAM & /v1/systemone setup

Call Nimble 9B

Pull it with Ollama 0.35 or newer, then POST to /v1/systemone. Do not use ollama chat commands — this is not a chat model.

Question types

choice noul (yes / no) score

Inputs

text

Max candidates per question

255

Serve with

ollama pull nimble

Endpoint

/v1/systemone

curl http://localhost:11434/v1/systemone \
  -H 'Content-Type: application/json' \
  -d '{
    "model": "nimble",
    "state": {
      "ticket": "I was charged twice. Please refund the extra payment."
    },
    "questions": {
      "team": {
        "type": "choice",
        "instructions": "Which team should handle this ticket?",
        "criteria": {
          "billing": "Payments and refunds",
          "technical": "Bugs and integrations",
          "other": "None of the above"
        }
      }
    }
  }'

Build a request for this model → Decision models guide

Other decision models: Tev1 4B · Tev1 0.8B · Winnow 12B · Winnow E4B · Decider 2B · Decider 4B · Decider 35B-A3B (NVFP4) · Decider 12B Vision · Decider 31B v2 (NVFP4) · JevK5 4B · Intern-Decision 4B · AutoJev 27B · Laya · Clef 27B · Clef-Flash 9B · Rune 26B-A4B v3 · OpenDecider-nano · OpenDecider-small · OpenDecider-small MLX 4-bit · Bosun v3.1 0.6B · Bosun v3.1 1.7B · d1-3B · d1-omni-600M · THX-01 322M · mammoth-1 27B · elephant-1 9B · Strands Decider 2B (hobson-v21) · kev 4B · kev 9B · OpenJev 27B

Hardware fit

Weights plus overhead plus the KV cache at a 8,192-token prompt, on NVIDIA RTX 4090 (24 GB). A publisher build is sized from its file; the other rows are modelled at a standard quant. Decision requests are short, so no long-context figure is shown.

Published file size: Ollama build 9.5 GB. A download size from the model publisher — not a VRAM requirement.

Ollama build is 9.5 GB. Which Bespoke checkpoint the tag packages (Sep 24 update vs original-2676) is not stated in one place; do not print a version.

How it was scored

Two different suites on two different scales. Never compare the numbers across the two cards.

Published latency

As published, on the device and under the condition shown. A decision model answers in one forward pass, so this is time per decision, not tokens per second.

The Index scored the repository bespokelabs/Bespoke-Nimble-9B-v2, not the checkpoint this page describes.

Decision models are not ranked on chat, creative or coding scores.

Specifications

Verified — Checked against the primary source — the model card or the vendor spec page — and corroborated by a second independent source.

Parameters

9.65B

Context window

8K (prompt limit)

Architecture

Fine-tune of Qwen/Qwen3.5-9B

Provider

Bespoke Labs

Licence

Apache-2.0

Practical deployment

Laptop

Specified at

Q4_K_M

System RAM

14 GB

Record updated

2026-09-30

Nimble 9B — frequently asked questions