Local AI Tools

Self-improving AI agent with persistent memory, built-in lea

The simplest way to run open-source LLMs locally - pull a

Node-based UI for Stable Diffusion, Flux, video generation,

High-throughput LLM serving engine with PagedAttention - t

All-in-one local RAG application - workspaces, document ch

The AI that really does things. Any OS. Any Platform. The lo

The agent harness performance optimization system. Skills, i

The web data API to search, scrape, and interact at scale. �

🤗 Transformers: the model-definition framework for state-of

Feature-rich web interface for Stable Diffusion with extensi

Low-code visual framework for building multi-agent and RAG a

Turn any codebase, with its docs, SQL schemas, configs, and

Implement a ChatGPT-like LLM in PyTorch from scratch, step b

Persistent Context Across Sessions for Every Agent – Captur

Open-source RAG engine with deep document understanding for

Turn any idea, plan, or codebase into a beautiful interactiv

2x faster LLM fine-tuning with 50% less memory - supports

Free-to-use, locally running, privacy-aware chatbot that wor

Easy-to-use LLM fine-tuning framework with web UI, supportin

🌟 The Multi-Agent Framework: First AI Software Company, Tow

Natural language interface that lets LLMs run Python, JavaSc

1 min voice data can also be used to train a good TTS model!

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs

Agent skill that removes signs of AI-generated writing from

Drag-and-drop LLM flow builder with LangChain integration fo

Image generation that reimagines Stable Diffusion with a min

aider is AI pair programming in your terminal

Ultra-lightweight, open-source, self-hosted personal AI agen

Gradio-based web UI for LLMs supporting multiple inference e

Secure, fast, efficient, battle-tested at Alibaba's scale. H

Cloud-native vector database for billion-scale AI similarity

Enhanced ChatGPT clone with multi-model, multi-user, and mul

Build resilient agents.

Full-stack framework for building multi-modal AI agents with

A library for efficient similarity search and clustering of

Easily train a good VC model with voice data <= 10 mins!

Instant voice cloning by MIT and MyShell. Audio foundation m

Vane is an AI-powered answering engine.

7.4 billion tokens per month. 34 free LLM providers. 635 fre

🪢 Open source LLM engineering platform: LLM Observability,

Powerful, customizable chat interface for roleplaying with l

ChatDev 2.0: Dev All through LLM-powered Multi-Agent Collabo

Enterprise-grade AI search and chat over your documents, Sla

Open-source, self-hosted alternative to OpenAI Dots, Grok Bo

Open-source alternative to AI video platforms — Free AI imag

A self-hostable bookmark-everything app (links, notes and im

The AI-native open-source embedding database designed for si

MLX: An array framework for Apple silicon

Microsoft's SDK for integrating LLMs with C#, Python, and Ja

Open-source NLP framework for building production-ready RAG

Faster Whisper transcription with CTranslate2

在 dsh 里装上这个插件即可，无需登录、注册或填 API Key，就能使用包括 DeepSeek V4.1 Flash

Open-source vector similarity search for Postgres

LLM inference server with continuous batching & SSD caching

Large-scale Self-supervised Pre-training Across Tasks, Langu

🚀 自托管的抖音、TikTok 数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音

<⚡️> SuperAGI - A dev-first open source autonomous AI agent

Air-gapped, privacy-focused, open-source NotebookLM alternat

Every agent's model. One place. Codex on DeepSeek, Claude Co

Cross-platform speech processing toolkit for STT, TTS, VAD,

A multi-voice TTS system trained with an emphasis on quality

Automation foundation model for tiny devices: 2-bit, 8-29 MB

Self-hosted gym & body-weight tracker — plan routines, log w

Enhanced fork of AUTOMATIC1111's WebUI with 2x faster infere

Run any open-source LLMs, such as DeepSeek and Llama, as Ope

KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. O

Fast, local neural text-to-speech that runs in real-time on

OpenVINO™ is an open source toolkit for optimizing and deplo

High-speed Large Language Model Serving for Local Deployment

Fine-tune LLMs from one YAML. Layer streaming trains an 8B m

A 2.78-trillion-parameter Kimi K3 running inference on a sin

Self-hosted multi-protocol AI API proxy for Antigravity, Cod

A Datacenter Scale Distributed Inference Serving Framework

Open-source, self-hosted CMS platform on AWS serverless (Lam

Turn your PC, Mac, or Linux box into an AI server. LLM infe

top #1 and most feature rich GPT wrapper for git — generate

Sandstorm is a self-hostable web productivity suite. It's im

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series Ma

Self-hosted AI accounting app. LLM analyzer for receipts, in

The agent-native LLM router for autonomous agents. 55+ model

IntentKit is an open-source, self-hosted cloud agent cluster

Self-hosted AI agent orchestration platform: dispatch tasks,

Standardized Distributed Generative and Predictive AI Infere

⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible,

Open source voice AI platform. Self-hosted alternative to Va

PyTorch-native library for easily fine-tuning LLMs with memo

Superduper: End-to-end framework for building custom AI appl

Demystify AI agents by building them yourself. Local LLMs, n

Modern, modular Stable Diffusion UI with ComfyUI integration

Local persistent memory store for LLM applications including

AI-powered penetration testing assistant using local LLM on

The fastest local AI engine for Apple Silicon. 4.2x faster t

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local d

Personal AI Notebooks. Organize files & webpages and generat

Local First Ai Agent. Optimized for Local Ai models. Long co

A native macOS app that allows users to chat with a local LL

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveil

Enhances Tesseract OCR output using LLMs (local or API) for

Fast LLM speculative inference server for consumer hardware.

A coding agent optimized to smaller LLMs

Translate full-length books and documents with Ollama, OpenA

Free, high-quality text-to-speech API endpoint to replace Op

The ultimate zero-install, portable local AI environment. Ru

Local AI app and inference engine for agents. Run open-weigh

Row-Bot - Personal AI Sovereignty. A local-first AI assistan

Lightweight, OpenAI-compatible API server for ExLlamaV2 with

Mobile-native local AI Agent framework for phones and edge d

⚡ Native MLX Swift LLM inference server for Apple Silicon. O

Free, open-source alternative to Weavy AI, Krea Nodes, Freep

Open source, local, and self-hosted highly optimized languag

Voice AI runtime. Local first transcription, speaker diariza

Desktop GUI for running local LLMs - model browser, chat,