Inkling 2 Small
thinkingmachinesapache-2.0textvision

Inkling 2 Small

Updated Nov 21, 2026
Parameters
594B
Context
8,192
License
apache-2.0
Q4 GGUF
354.15 GB
Updated
Nov 21, 2026

Q4 GGUF download: unsloth/Inkling-2-Small-GGUF - 354.15 GB on disk, read 2026-11-16. VRAM figures above are estimates; this is the actual file size.

Intelligence benchmarks

Artificial Analysis indexes - compared with the best open and proprietary models

Intelligence

30.6

AA Index

Coding

20.5

AA Index

Agentic

35.4

AA Index

Intelligence Index - Inkling 2 Small vs. the field

Best open-weight models (you can run locally) and leading proprietary models for context.

Claude Fable 5.2
64.6
closed
GPT-6.2 Astra
62.1
closed
Gemini 4 Neon
61.4
closed
Gemini 4 Carbon
60
closed
Claude Opus 5.5
59.1
closed
Kimi K3.1 Pro
46.5
open
DeepSeek V4.1 Flash 1017
32.6
open
Inkling 2 Small
30.6
open

Coding Index comparison

GPT-6.2 Astra
55
closed
Claude Fable 5.2
53.3
closed
Gemini 4 Neon
52.1
closed
Claude Opus 5.5
51.7
closed
GPT-6.2 Sol
50.7
closed
Kimi K3.1 Pro
42.1
open
DeepSeek V4.1 Flash 1017
30.6
open
Inkling 2 Small
20.5
open

Agentic Index comparison

Gemini 4 Neon
56.3
closed
Gemini 4 Carbon
53.6
closed
GPT-6.2 Astra
53.5
closed
Kimi K3.1 Pro
52.3
open
Gemini 4 Hydrogen
52.2
closed
Muse Wonder Full
52
closed
MiniMax-M3.1-Flash
46.7
open
Inkling 2 Small
35.4
open

Benchmark data from Artificial Analysis · updated 2026-11-21.

Hosted API cost & speed

What it costs to rent this model instead of running it locally

MetricValue
Input (per 1M tokens)$0.30
Output (per 1M tokens)$1.00
Median speed (hosted API)94 tok/s

Median across hosted providers, measured by Artificial Analysis - updated 2026-11-21. Local llama.cpp speed depends on your hardware — see the hardware pages for estimates.

Arena rating (LMArena)

Human preference wins from head-to-head chat battles

MetricValue
Overall arena rating1402.6
Rank (overall)#159
Battle votes2,678

Overall rating published by LMArena on 2026-11-19 - a pairwise human-preference Elo across live chat battles; higher is better. Fetched 2026-11-21. Open-weights models compete head-to-head with proprietary ones here — no benchmark prompts, just what people pick.

Standard benchmarks

Performance across standard evaluations

BenchmarkScore
HLE44.1
SciCode52.3

Source: Artificial Analysis component evals - updated 2026-11-21.

Will it run on your hardware?

Pick your GPU memory - see which quantizations fit, and the cheapest card for the rest

Too big for 24 GB at any quant
0 of 4 quantizations fit Inkling 2 Small with real runtime overhead.
Q4_K_M
345 GB
Q5_K_M
422 GB
Q8_0
636 GB
FP16
1188 GB
fits tight too big

Need an exact figure for your context length? Use the VRAM calculator.

Run it locally

Copy-paste - running in under a minute

vLLMOpenAI-compatible API
vllm serve thinkingmachines/Inkling-2-Small

New to this? Start with Ollama · serve to many users with vLLM.

Deep dive

Notes, sources, and the full write-up

Inkling 2 Small is a 594.1B-parameter apache-2.0 model from Thinking Machines. It scores 30.6 on the Artificial Analysis Intelligence Index (coding 20.5). At Q4_K_M it needs roughly 345 GB of VRAM, placing it in the 48 GB+ / multi-GPU hardware tier.

BenchmarksLink to this section

Artificial Analysis Intelligence Index - Inkling 2 Small vs. leading closed models:

ModelIntelligenceCodingGPQA
Inkling 2 Small30.620.5-
Claude Fable 5.264.653.1-
GPT-6.2 Astra62.152.9-
Gemini 4 Neon61.452.1-
Gemini 4 Carbon6050.4-
Claude Opus 5.559.151.7-

Source: Artificial Analysis (2026-11-21).

PopularityLink to this section

Inkling 2 Small has 7,329 downloads in the last month on HuggingFace and 347 likes.

Frequently asked

Quick answers to common questions

How much VRAM does Inkling 2 Small need?

Inkling 2 Small with 594B parameters needs approximately 345 GB at Q4_K_M quantization. Use our VRAM calculator for an exact estimate.

Is Inkling 2 Small better than other thinkingmachines models?

Inkling 2 Small has 594B parameters with 8,192 context - a strong choice for reasoning, vision, general-chat.

What license is Inkling 2 Small under?

Inkling 2 Small is released under the apache-2.0 license, making it suitable for most commercial and personal projects.

What hardware runs Inkling 2 Small well?

With 594B parameters, Inkling 2 Small requires adequate VRAM. High-end GPUs like the RTX 4090 (24GB), RTX 5090 (32GB), or Mac Studio with unified memory are good options. Check our hardware directory for specific recommendations.

What is the best quantization for Inkling 2 Small?

Q4_K_M is the recommended sweet spot - ~98% of FP16 quality at ~27% of the size. Q5_K_M (~422 GB) is an option if you have spare VRAM. Use our VRAM calculator to compare.

What models compete with Inkling 2 Small?

Inkling 2 Small competes with other 297B–891B. Browse our model directory for comparisons, benchmarks, and community reviews to find the best fit.

Nearby options

Similar models and compatible hardware by spec