NuminaMath — LLM Reasoning Dataset

860K competition and olympiad-level math problems with curated, structured solutions. Created for the AI Mathematical Olympiad challenge, NuminaMath represents the frontier of mathematical reasoning datasets, covering AMC, AIME, and international olympiad problems.

Dataset Details

ProviderAI-MO
CategoryReasoning
Size860K Problems
LicenseApache 2.0
Downloads520k
TagsOlympiad Math, Competition, Chain-of-Thought, AIMO, 2024
 
from datasets import load_dataset
ds = load_dataset("AI-MO/NuminaMath-CoT")

Fine-tune with this dataset

Estimated VRAM to fine-tune with QLoRA (4-bit base model + LoRA adapters), using conservative defaults:

7B QLoRA~6GB VRAM
13B QLoRA~10GB VRAM

Check if your GPU can fine-tune this →

New to fine-tuning? Follow the step-by-step walkthrough: Fine-Tune Your First LLM in 1 Hour

Related datasets

Frequently asked questions

Can I use NuminaMath commercially?
Yes — NuminaMath is released under Apache 2.0, a permissive license that allows commercial use, including training models you ship in a product. Check the dataset card for attribution requirements before release.
How much data does NuminaMath contain, and do I need all of it?
NuminaMath contains 860K Problems. You rarely need all of it: for style and format fine-tuning, a few hundred to a few thousand examples are enough — load a slice (e.g. split="train[:1000]") and scale up only if quality plateaus.
What is NuminaMath best used for?
Chain-of-thought math fine-tuning up to olympiad level. It belongs to the Reasoning section of our dataset hub, where you'll find alternatives and complementary sets.

← All datasets | Fine-Tuning Guide