koboldcpp social preview
other12,028AGPL-3.0

koboldcpp

KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.

Updated Oct 19, 2026
Website GitHub
Platforms
macos, linux, windows, docker, web
Pricing
free-open-source
Status
active
License
AGPL-3.0

What it does

Core capabilities at a glance

  • Gemma
  • Ggml
  • Gguf
  • Koboldai
  • Koboldcpp
  • Language Model
  • Llama
  • Llamacpp

Deep dive

The full breakdown - performance, comparisons, and setup

koboldcpp

koboldcpp is a local-AI tool - KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.

Overview

KoboldCpp is free and open-source software for running GGUF large language models (LLMs) on your own computer. Chat with an AI assistant, write stories, roleplay, or connect other apps to a local API. KoboldCpp runs on CPU or GPU and also includes text, image, video, speech and music generation with compatible models, an integrated agent, a bundled KoboldAI Lite WebUI, and many additional powerful features.

One executable file, no installation required. Ready-to-run downloads are available for Windows, Linux, and macOS.

koboldcpp is open-source, written primarily in C++, with 12,028 GitHub stars under the AGPL-3.0 license. The latest release is v1.123.1 (2026-10-13).

Key capabilities

From the project's documentation:

  • Video generation: Supports WAN 2.2, LTX2.3, MiniMax H3 and more.
  • Voice recognition: Speech-to-text with Whisper, and multimodal audio from Gemma4 E2B and E4B.
  • Speech generation: Text to speech with Qwen3TTS, Kokoro, OuteTTS, Parler, and Dia.
  • Music generation: ACE Step 1.5 and ACE Step XL.
  • Need help launching? See the platform instructions.
  • A dedicated GPU is optional; the model size and context length determine how much memory you need.

How it fits a local-AI stack

koboldcpp runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related local-AI tools in the directory:

Sources

Stats from GitHub, 2026-10-19.

Frequently asked

Quick answers to common questions

What is koboldcpp?

koboldcpp is a other tool for local AI workloads. KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.

Is koboldcpp free and open source?

Yes, koboldcpp has 12,028 GitHub stars and is licensed under AGPL-3.0. You can self-host it for free on macos, linux, windows, docker, web.

What platforms does koboldcpp support?

koboldcpp runs on macos, linux, windows, docker, web.

What hardware do I need for koboldcpp?

The hardware requirements depend on which models you run. Check our hardware directory for compatible GPUs and systems. koboldcpp has 12,028 GitHub stars and an active community.

Does koboldcpp support GPU acceleration?

koboldcpp supports GPU acceleration via CUDA, Metal, or Vulkan depending on your platform. For the best performance, pair it with an NVIDIA RTX 4090 or 5090.

What are the best alternatives to koboldcpp?

Popular alternatives include other other tools in our directory. Browse our full collection at /tool for comparisons, community reviews, and benchmark data to find the right fit for your workflow.

How much does koboldcpp cost?

koboldcpp is free-open-source. It is completely free and open source to self-host.

Pairs well with

Complementary tools, models, and hardware