GetInfoUs
NVIDIA

Nemotron Mini 4B Instruct

Vérifié par l’équipe de recherche de GetInfoUsDernière révision : October 2026Politique éditoriale
Nemotron minusculeOfficial Source Verified ↗
35
Intelligence Index

ultra-compact 4B instruct modèle optimized par NVIDIA pour sur-device roleplay, RAG assistance, et PC périphérie déploiements.

Input / Output
$0.05 / $0.15
per 1M tokens
Context
128K tokens
window
Speed
160
tok/s
Latency
0.25s
TTFT

Technical Specifications

Provider
NVIDIA
Category
open-source
Release Date
2024-08
Knowledge Cutoff
June 2024
Architecture
Pruned and Distilled Compact Transformer
Parameters
4B
Context Window
128K tokens
Max Output
4K tokens
Cached Input Price
$0.02 / 1M tokens
Batch API Discount
50% off async batch
Consumer Subscription
Free / Self-Hosted
Reasoning Mode
No (Standard)
Reasoning Effort Control
Fixed
Tool Calling
Yes
Structured Outputs
Yes
Open Weights
Yes (Open Source / Self-Hostable)
Input Modalities
text
Output Modalities
text
Official Documentation
Visit Official Docs ↗

Data Privacy, Licensing & Deployment Governance

API Data Training Policy
100% Isolated when self-hosted on private GPUs or VPC
Model License & Commercial Rights
Open-Weights Research & Commercial License
Deployment & Cloud Availability
Self-Hosted GPU (vLLM / Ollama), Private VPC, or Managed Serverless API
Output Ownership
Full commercial ownership of generated outputs

Official Provider Release Intelligence, API Quotas & Agentic Specs

Compare Multi-Models Side-by-Side →
Official API Model ID (SDK String)
nemotron-mini-4b
Supported SDK & API Protocol
OpenAI-Compatible REST / vLLM / SGLang / HuggingFace TGI
Lifecycle & Deprecation Status
Legacy Stable (Upgrade path available in NVIDIA lineup)
Production Rate Limits (RPM & TPM)
Unlimited (Hardware-bound on self-hosted GPU) / 10,000 RPM Cloud · Unlimited local throughput / 10M+ TPM Managed Cloud
Long-Context Pricing Tier (>128K / >200K)
Flat rate ($0.05/1M in) across full 128K window
Prompt Cache Write & TTL Policy
Cached input at $0.02/1M tokens
Computer Use & Browser GUI Agent
API / CLI Tool-Use & DOM Agent ready (no raw pixel desktop click loop)
MCP & Parallel Tool Calling
Native MCP Client/Server ready · Parallel function calling · 100% Strict JSON Schema
Web Search Grounding & Code Sandbox
Supported via external Tavily/Exa Search & E2B/Docker Sandbox tools
Fine-Tuning & Distillation Support
Full Weights SFT, LoRA, QLoRA, DPO & GRPO RL (Unsloth / Axolotl / Llama-Factory)
Multimodal Tokenization Billing
Text BPE (~4 chars/token)
Weights Precision & Quantization
BF16 / FP16, FP8 Dynamic, INT4 AWQ / GPTQ, GGUF (Q4_K_M / Q8_0)
Minimum GPU VRAM Requirement
2 GB VRAM (4-bit Quantized) · 9 GB VRAM (Native BF16)
Supported Inference Engines
vLLM, SGLang, Ollama, llama.cpp, TensorRT-LLM, HuggingFace TGI
System Card & Safety Framework
Open-Weights System Card + Customizable Guardrail Layer (Llama Guard / ShieldGemma)
Enterprise Compliance (SOC2 / HIPAA / ZDR)
100% Air-Gapped On-Premises / Private VPC · Full HIPAA, GDPR & SOC2 Control
Engineering & Pricing Workbench

Nemotron Mini 4B Instruct Cost, Context, Hardware & API Integration

500 / day
4,000 tok
1,000 tok
Conversation Depth (History Re-billing):1 Turn (Single-Shot)
50%
Estimated Monthly API Cost (30 Days)
$4.35$5.25
Monthly Savings: $0.90 (Caching/Batch)
Daily Cost:
$0.15
Cost per Request:
$0.00029
Effective Input / 1M:
$0.035
Effective Output / 1M:
$0.150
Subscription ($20/mo) vs API

Pay-as-you-go API is cheaper for this volume (saves $15.65/mo vs $20 flat plan).

Break-even point: ~2,299 requests/day equals $20/month.

Same Monthly Workload Cost Across Popular Reference Models

Nemotron Mini 4B Instruct (Active)
$4.35
/ month
Gemini 2.5 Flash
$18.00
/ month
DeepSeek V3
$32.70
/ month
GPT-4o
$300.00
/ month
Claude 3.7 Sonnet
$405.00
/ month

Live Prompt Paste Tokenizer & Cost Counter

Paste real system instructions, JSON schemas, or code to measure BPE token counts across tokenizers.

Chars / Words
175 / 24
OpenAI o200k
~46 tok
Claude BPE
~49 tok
Llama / DeepSeek
~51 tok

Hybrid Prompt Routing Cascade Simulator

Route routine queries to a fast lightweight model ($0.15/1M) and escalate only complex reasoning turns to Nemotron Mini 4B Instruct:

Cascaded Monthly Bill:$14.59/mo
This model is already priced at or below the fast router baseline.

Benchmark Scores & 6-Axis Capability Radar

Benchmark Encyclopedia
Coding (35)Reasoning (44)Knowledge (59)Speed (100)Context (75)Cost Value (94)
Nemotron Mini 4B Instruct2026 Frontier Median
SWE-bench Verified
22%
GPQA Diamond
38%
MMLU-Pro
58.5%
HumanEval
68.5%
Terminal-Bench
20%
AIME
38%
Long-Context Reasoning
58%
Chatbot Arena Elo
1180pts

Strengths

  • ultra-léger 4B empreinte running smoothly sur grand public RTX GPUs et laptops
  • Engineered par NVIDIA avec TensorRT-LLM acceleration pour extreme débit
  • complet 128K fenêtre de contexte avec permissive à poids ouverts

Limitations & Trade-offs

  • limité raisonnement profondeur sur complexe mathématique et scientifique tâches
  • texte-seulement sans natif multimodal traitement

Editorial Assessment

un masterclass dans modèle distillation et matériel-optimized périphérie computing.

Best for: local desktop AI companions, offline périphérie PCs, et élevé-vitesse données extraction

Compare Nemotron Mini 4B Instruct

Nemotron Mini 4B Instruct vs Llama 3.1 Nemotron 70B InstructNemotron Mini 4B Instruct vs Mistral NeMoNemotron Mini 4B Instruct vs Gemini 4 ArgonNemotron Mini 4B Instruct vs GPT-6 AstraNemotron Mini 4B Instruct vs Claude Opus 5.5Nemotron Mini 4B Instruct vs GPT-6.1 Sol

Frequently Asked Questions about Nemotron Mini 4B Instruct

How much does the Nemotron Mini 4B Instruct API cost per 1M tokens?+

Nemotron Mini 4B Instruct by NVIDIA is priced at $0.05 per 1M input tokens and $0.15 per 1M output tokens. With prompt caching enabled, cached input tokens cost $0.02 per 1M tokens, and asynchronous Batch API requests receive a 50% discount.

Should I use a $20/month subscription or the Nemotron Mini 4B Instruct pay-as-you-go API?+

A flat $20/month consumer subscription is predictable for daily interactive chat and manual coding. However, if you are building software, running automated workflows, or sending low-to-moderate volume with prompt caching enabled, the pay-as-you-go API is typically far more cost-effective and offers higher rate limits without manual UI caps.

How many words and pages fit in Nemotron Mini 4B Instruct's context window?+

Nemotron Mini 4B Instruct features a 128K tokens context window, which equals approximately 96,000 English words or ~256 standard single-spaced pages in a single prompt. Its maximum output generation per turn is 4,096 tokens.

Can I run Nemotron Mini 4B Instruct locally on my own GPU (Open Weights)?+

Yes, Nemotron Mini 4B Instruct (4B) releases open weights that can be self-hosted locally or on private cloud GPUs using vLLM, Ollama, SGLang, or llama.cpp.

Does NVIDIA train on data sent to the Nemotron Mini 4B Instruct API, and is commercial use allowed?+

100% Isolated when self-hosted on private GPUs or VPC. License tier: Open-Weights Research & Commercial License. Full commercial ownership of generated outputs. Supported deployment channels include: Self-Hosted GPU (vLLM / Ollama), Private VPC, or Managed Serverless API.

How does Nemotron Mini 4B Instruct perform on coding and reasoning benchmarks?+

Nemotron Mini 4B Instruct achieves a composite Intelligence Index of 35/100, scoring 22% on SWE-bench Verified, 38% on GPQA Diamond, 58.5% on MMLU-Pro, and 1180 pts on Chatbot Arena Elo.

What is Nemotron Mini 4B Instruct best used for?+

Nemotron Mini 4B Instruct is best suited for: local desktop AI companions, offline périphérie PCs, et élevé-vitesse données extraction. Assessment: un masterclass dans modèle distillation et matériel-optimized périphérie computing.

NVIDIA Family Lineage, Routing Tiers & Upgrade Path

Step down to a lighter sibling for high-volume routing or step up to NVIDIA's flagship reasoning tier:

Higher-Intelligence Upgrade2026-06

Nemotron 3 Ultra 550B A55B

$1 / $3 · 1M tokensIQ 60
Higher-Intelligence Upgrade2026-06

Nemotron 3.5 Content Safety

$0.08 / $0.16 · 128K tokensIQ 39
Higher-Intelligence Upgrade2026-04

Nemotron 3 Nano Omni 30B A3B Reasoning

$0.2 / $0.6 · 256K tokensIQ 48
Higher-Intelligence Upgrade2026-04

Nemotron 3 Content Safety

$0.05 / $0.1 · 128K tokensIQ 37
Higher-Intelligence Upgrade2026-03

Nemotron 3 Super 120B A12B

$0.3 / $0.8 · 262K tokensIQ 53
Higher-Intelligence Upgrade2026-03

Nemotron VoiceChat

$0.5 / $1.5 · 128K tokensIQ 49

AI Glossary & Architecture Concepts

View full glossary →

Key machine learning concepts and benchmarks relevant to Nemotron Mini 4B Instruct:

Jeton (Token)

L'unité textuelle de base traitée par un modèle linguistique, représentant généralement 3 à 4 caractères ou environ 0,75 mot. Par exemple, une phrase courante est découpée en plusieurs jetons.

Benchmark (Banc d’essai)

Une suite de tests standardisés permettant d'évaluer et de comparer objectivement les performances des modèles d'IA sur des tâches ciblées (code avec SWE-bench, mathématiques avec AIME, etc.).

Fenêtre de contexte

Le nombre maximal de jetons qu'un modèle peut traiter simultanément (entrée et sortie comprises). Une fenêtre de 1 000 000 jetons permet d'analyser environ 750 000 mots en une seule requête.

Appel d'outils (Tool Calling)

La capacité d'un LLM à déterminer quand une action externe est requise et à générer des arguments structurés pour invoquer des API, calculatrices ou bases de données avant de poursuivre.

Protocole de contexte de modèle (MCP)

Un standard ouvert créé par Anthropic permettant aux agents d'IA de se connecter de façon uniforme aux systèmes de fichiers locaux, aux environnements de développement et aux API tierces.

Entrée en cache (Cached Input)

Une optimisation tarifaire et technique conservant les états d'attention des préfixes de prompts récurrents, réduisant les coûts d'entrée de 50 à 90 % tout en abaissant la latence.

← Back to all models

Les scores de benchmarks, tarifs par token et limites évoluent rapidement. Vérifiez toujours les spécifications actuelles sur la documentation officielle du fournisseur.

Sources: NVIDIA Technical Blog & Hugging Face Release (Aug 2024)↗