What it does
Core capabilities at a glance
- Supports Transformers, ExLlamaV2, llama.cpp, and more backends
- Multi-modal (LLaVA, CogVLM, and other vision models)
- Chat, default, notebook, and cai-chat modes
- LoRA loading and training
- Extension ecosystem (TTS, vector storage, gallery)
- OpenAI-compatible API endpoint
Deep dive
The full breakdown - performance, comparisons, and setup
Text Generation WebUI (oobabooga)
Text Generation WebUI, commonly called oobabooga, is the most flexible LLM interface available. It supports every major inference engine, model format, and has built-in LoRA training.
What it is
Created by oobabooga, this Gradio-based web UI can load models using Transformers, ExLlamaV2, llama.cpp, AutoGPTQ, and AWQ backends. It includes chat, notebook, and training interfaces.
Get started
git clone https://github.com/oobabooga/text-generation-webui
cd text-generation-webui
start_windows.bat # or ./start_linux.shWhen to use something else
Frequently asked
Quick answers to common questions
What is Text Generation WebUI?
Text Generation WebUI is a chat-ui tool for local AI workloads. Gradio-based web UI for LLMs supporting multiple inference engines, LoRA training, and extensions.
Is Text Generation WebUI free and open source?
Yes, Text Generation WebUI has 47,284 GitHub stars and is licensed under AGPL-3.0. You can self-host it for free on linux, windows, macos.
What platforms does Text Generation WebUI support?
Text Generation WebUI runs on linux, windows, macos.
What hardware do I need for Text Generation WebUI?
The hardware requirements depend on which models you run. Check our hardware directory for compatible GPUs and systems. Text Generation WebUI has 47,284 GitHub stars and an active community.
Does Text Generation WebUI support GPU acceleration?
Text Generation WebUI supports GPU acceleration via CUDA, Metal, or Vulkan depending on your platform. For the best performance, pair it with an NVIDIA RTX 4090 or 5090.
What are the best alternatives to Text Generation WebUI?
Popular alternatives include other chat-ui tools in our directory. Browse our full collection at /tool for comparisons, community reviews, and benchmark data to find the right fit for your workflow.
How much does Text Generation WebUI cost?
Text Generation WebUI is free-open-source. It is completely free and open source to self-host.
Pairs well with
Complementary tools, models, and hardware
Comments coming soon
Configure NEXT_PUBLIC_GISCUS_REPO_ID and NEXT_PUBLIC_GISCUS_CATEGORY_ID at giscus.app to enable.