Local AI Tools
59 tools indexed
Platform
Pricing
| Name | Category | Platform | Pricing | Stars | Compatible |
|---|---|---|---|---|---|
| n8n Self-hosted workflow automation with native LLM, vector DB, | automation | dockerlinux | Free | 191.5k | - |
| Hermes Agent Self-improving AI agent with persistent memory, built-in lea | agent-framework | macoslinux | Free | 185.7k | - |
| Ollama The simplest way to run open-source LLMs locally - pull a | inference-server | macoslinux | Free | 173.5k | - |
| Open WebUI The ChatGPT-style web interface for Ollama and any OpenAI-co | chat-ui | dockerlinux | Free | 140.5k | - |
| ComfyUI Node-based UI for Stable Diffusion, Flux, video generation, | image-gen | windowsmacos | Free | 116.1k | - |
| llama.cpp High-performance LLM inference in pure C/C++ with GPU accele | inference-server | macoslinux | Free | 115.2k | - |
| vLLM High-throughput LLM serving engine with PagedAttention - t | inference-server | linuxdocker | Free | 82.2k | - |
| AnythingLLM All-in-one local RAG application - workspaces, document ch | rag | dockermacos | Free | 61.2k | - |
| Odysseus Self-hosted AI workspace with chat, autonomous agents, deep | chat-ui | macoslinux | Free | 61.1k | - |
| Jan Open-source, offline-first ChatGPT alternative that runs 100 | chat-ui | macoslinux | Free | 42.9k | - |
| AutoGPT Autonomous AI agent that breaks down goals into sub-tasks, e | agent-framework | linuxmacos | Free | 184.8k | - |
| Stable Diffusion WebUI (AUTOMATIC1111) Feature-rich web interface for Stable Diffusion with extensi | image-gen | linuxwindows | Free | 163.5k | - |
| Langflow Low-code visual framework for building multi-agent and RAG a | workflow | webdocker | Free | 149.4k | - |
| Dify Open-source LLM app development platform with visual orchest | workflow | webdocker | Freemium | 144.3k | - |
| LangChain Framework for developing LLM-powered applications with compo | agent-framework | linuxmacos | Free tier | 138.7k | - |
| Miso One / MisoTTS Open-weight 8B text-to-speech model with human-like emotion, | tts-stt | macoslinux | Free | 2.2k | - |
| NextChat Lightweight, cross-platform ChatGPT UI that deploys in one c | chat-ui | webdocker | Free tier | 88.2k | - |
| RAGFlow Open-source RAG engine with deep document understanding for | rag | dockerlinux | Free | 82.1k | - |
| LobeChat Modern, open-source ChatGPT/Claude UI with plugin ecosystem, | chat-ui | webdocker | Free tier | 78.3k | - |
| GPT4All Free-to-use, locally running, privacy-aware chatbot that wor | chat-ui | macoslinux | Free | 77.4k | - |
| LLaMA-Factory Easy-to-use LLM fine-tuning framework with web UI, supportin | fine-tuning | linuxdocker | Free | 72.0k | - |
| Unsloth 2x faster LLM fine-tuning with 50% less memory - supports | fine-tuning | linuxdocker | Free tier | 66.0k | - |
| Open Interpreter Natural language interface that lets LLMs run Python, JavaSc | agent-framework | macoslinux | Free | 63.8k | - |
| Mem0 Intelligent memory layer for AI apps that learns user prefer | other | linuxdocker | Freemium | 58.0k | - |
| Flowise Drag-and-drop LLM flow builder with LangChain integration fo | workflow | webdocker | Freemium | 53.4k | - |
| CrewAI Framework for orchestrating role-based AI agents that collab | agent-framework | linuxmacos | Free tier | 53.0k | - |
| Whisper.cpp High-performance, real-time speech-to-text using OpenAI's Wh | tts-stt | macoslinux | Free | 50.5k | - |
| Fooocus Image generation that reimagines Stable Diffusion with a min | image-gen | linuxwindows | Free | 49.8k | - |
| Text Generation WebUI Gradio-based web UI for LLMs supporting multiple inference e | chat-ui | linuxwindows | Free | 47.3k | - |
| LocalAI Self-hosted, OpenAI-compatible API server for LLMs, image ge | inference-server | linuxdocker | Free | 46.7k | - |
| Milvus Cloud-native vector database for billion-scale AI similarity | vector-db | dockerlinux | Freemium | 44.7k | - |
| Agno Full-stack framework for building multi-modal AI agents with | agent-framework | linuxmacos | Free | 40.6k | - |
| LibreChat Enhanced ChatGPT clone with multi-model, multi-user, and mul | chat-ui | webdocker | Free | 38.6k | - |
| Khoj Open-source, personal AI assistant that searches your notes, | rag | webdocker | Free tier | 35.0k | - |
| Continue Open-source AI code assistant that integrates with VS Code a | other | macoslinux | Free tier | 33.6k | - |
| Qdrant High-performance vector search engine written in Rust with r | vector-db | dockerlinux | Freemium | 31.9k | - |
| Onyx Enterprise-grade AI search and chat over your documents, Sla | rag | dockerlinux | Freemium | 30.1k | - |
| SillyTavern Powerful, customizable chat interface for roleplaying with l | chat-ui | webmacos | Free | 29.0k | - |
| Chroma The AI-native open-source embedding database designed for si | vector-db | dockerlinux | Free tier | 28.3k | - |
| Semantic Kernel Microsoft's SDK for integrating LLMs with C#, Python, and Ja | agent-framework | linuxmacos | Free | 28.1k | - |
| InvokeAI Professional-grade Stable Diffusion toolkit with unified can | image-gen | linuxwindows | Free | 27.4k | - |
| Haystack Open-source NLP framework for building production-ready RAG | rag | linuxmacos | Free | 25.5k | - |
| Mastra TypeScript agent framework with built-in model routing, agen | agent-framework | linuxmacos | Free | 24.8k | - |
| Vercel AI SDK Open-source TypeScript toolkit for building AI-powered UIs w | agent-framework | web | Free | 24.7k | - |
| Weaviate Open-source vector database with built-in vectorization, hyb | vector-db | dockerlinux | Freemium | 16.3k | - |
| TensorRT-LLM NVIDIA's optimized LLM inference engine delivering maximum p | inference-server | linux | Free | 13.8k | - |
| LitGPT Open-source tool for pretraining, fine-tuning, and deploying | fine-tuning | linuxdocker | Free | 13.4k | - |
| Sherpa Onnx Cross-platform speech processing toolkit for STT, TTS, VAD, | tts-stt | linuxwindows | Free | 12.8k | - |
| Stable Diffusion Forge Enhanced fork of AUTOMATIC1111's WebUI with 2x faster infere | image-gen | linuxwindows | Free | 12.7k | - |
| Axolotl Streamlined fine-tuning framework for LLMs with YAML configs | fine-tuning | linuxdocker | Free | 12.0k | - |
| Piper TTS Fast, local neural text-to-speech that runs in real-time on | tts-stt | linuxwindows | Free | 11.1k | - |
| Hugging Face Text Generation Inference Production-ready LLM inference server from Hugging Face with | inference-server | linuxdocker | Free | 10.9k | - |
| Kokoro TTS High-quality, lightweight neural TTS with 10+ voices, 2x fas | tts-stt | linuxmacos | Free | 7.4k | - |
| Genkit Google's open-source framework for building AI-powered appli | agent-framework | linuxmacos | Free | 6.1k | - |
| Torchtune PyTorch-native library for easily fine-tuning LLMs with memo | fine-tuning | linuxmacos | Free | 5.8k | - |
| ExLlamaV2 Fast inference library for quantized LLMs optimized for sing | inference-server | linuxwindows | Free | 4.5k | - |
| SwarmUI Modern, modular Stable Diffusion UI with ComfyUI integration | image-gen | linuxwindows | Free | 4.2k | - |
| TabbyAPI Lightweight, OpenAI-compatible API server for ExLlamaV2 with | inference-server | linuxwindows | Free | 1.2k | - |
| LM Studio Desktop GUI for running local LLMs - model browser, chat, | chat-ui | macoslinux | Free tier | - | - |