LLM-As-Chatbot social preview
chat-ui3,315Apache 2.0

LLM-As-Chatbot

LLM as a Chatbot Service

Updated Oct 31, 2026
GitHub Docs
Platforms
Pricing
free-open-source
Status
active
License
Apache 2.0

Deep dive

The full breakdown - performance, comparisons, and setup

LLM-As-Chatbot

LLM-As-Chatbot is a chat UI - LLM as a Chatbot Service.

Overview

  • Internet search support: you can enable internet search capability in Gradio application and Discord bot. For gradio, there is a 'internet mode' option in the control panel. For discord, you need to specify '--internet' option in your prompt. For both cases, you need a Serper API Key which you can get one from serper.dev. By signing up, you will get free 2,500 free google searches which is pretty much sufficient for a long-term test. - Discord Bot support: you can serve any model from the model zoo as Discord Bot. Find how to do this in the instruction section below.

The purpose of this repository is to let people to use lots of open sourced instruction-following fine-tuned LLM models as a Chatbot service. Because different models behave differently, and different models require differently formmated prompts, I made a very simple library 'Ping Pong' for model agnostic conversation and context managements.

Also, I made 'GradioChat' UI that has a similar shape to HuggingChat but entirely built in Gradio. Those two projects are fully integrated to power this project.

LLM-As-Chatbot is open-source, written primarily in Python, with 3,315 GitHub stars under the Apache 2.0 license. It was last updated on 2023-11-20.

Key capabilities

From the project's documentation:

  • @bot_name help: it will display a simple help message
  • mosaicml/mpt-7b-chat: MPT-7B from MOSAIC ML.
  • mosaicml/mpt-30b-chat: MPT-30B from MOSAIC ML.
  • project-baize/baize-v2-7b: LLaMA 7B based Baize
  • project-baize/baize-v2-13b: LLaMA 13B based Baize
  • Gradio components to control the configurations of the generation

Install

A quick way to get started (always check the official docs for the latest):

pip install -r requirements.txt

How it fits a local-AI stack

LLM-As-Chatbot runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related chat UIs in the directory:

Sources

Stats from GitHub, 2026-10-26.

Frequently asked

Quick answers to common questions

What is LLM-As-Chatbot?

LLM-As-Chatbot is a chat-ui tool for local AI workloads. LLM as a Chatbot Service

Is LLM-As-Chatbot free and open source?

Yes, LLM-As-Chatbot has 3,315 GitHub stars and is licensed under Apache 2.0. You can self-host it for free on .

What hardware do I need for LLM-As-Chatbot?

The hardware requirements depend on which models you run. Check our hardware directory for compatible GPUs and systems. LLM-As-Chatbot has 3,315 GitHub stars and an active community.

Does LLM-As-Chatbot support GPU acceleration?

LLM-As-Chatbot's GPU support depends on your specific setup. Check the documentation for details. For the best performance, pair it with an NVIDIA RTX 4090 or 5090.

What are the best alternatives to LLM-As-Chatbot?

Popular alternatives include other chat-ui tools in our directory. Browse our full collection at /tool for comparisons, community reviews, and benchmark data to find the right fit for your workflow.

How much does LLM-As-Chatbot cost?

LLM-As-Chatbot is free-open-source. It is completely free and open source to self-host.

Pairs well with

Complementary tools, models, and hardware