Local AI Tools

Self-improving AI agent with persistent memory, built-in lea

The simplest way to run open-source LLMs locally - pull a

Node-based UI for Stable Diffusion, Flux, video generation,

High-throughput LLM serving engine with PagedAttention - t

All-in-one local RAG application - workspaces, document ch

Open-weight 8B text-to-speech model with human-like emotion,

Feature-rich web interface for Stable Diffusion with extensi

Open-source LLM app development platform with visual orchest

Lightweight, cross-platform ChatGPT UI that deploys in one c

Modern, open-source ChatGPT/Claude UI with plugin ecosystem,

Easy-to-use LLM fine-tuning framework with web UI, supportin

Natural language interface that lets LLMs run Python, JavaSc

Framework for orchestrating role-based AI agents that collab

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs

Image generation that reimagines Stable Diffusion with a min

aider is AI pair programming in your terminal

Open-source desktop app for local LLMs. Text, vision, tool-c

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-te

Ray is an AI compute engine. Ray consists of a core distribu

Enhanced ChatGPT clone with multi-model, multi-user, and mul

Open-source, personal AI assistant that searches your notes,

Open-source AI code assistant that integrates with VS Code a

High-performance vector search engine written in Rust with r

Enterprise-grade AI search and chat over your documents, Sla

Cognee is the open-source AI memory platform for agents. Giv

Microsoft's SDK for integrating LLMs with C#, Python, and Ja

A self-hostable bookmark-everything app (links, notes and im

TypeScript agent framework with built-in model routing, agen

Open-source NLP framework for building production-ready RAG

Distribute and run LLMs with a single file.

Faster Whisper transcription with CTranslate2

Open-source data movement for ELT pipelines and AI agents —

Open-source vector database with built-in vectorization, hyb

The Self-hosted AI Starter Kit is an open-source template th

Cross-platform speech processing toolkit for STT, TTS, VAD,

Enhanced fork of AUTOMATIC1111's WebUI with 2x faster infere

Streamlined fine-tuning framework for LLMs with YAML configs

Production-ready LLM inference server from Hugging Face with

OpenVINO™ is an open source toolkit for optimizing and deplo

~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all

Self-hosted multi-protocol AI API proxy for Antigravity, Cod

Open-source, self-hosted CMS platform on AWS serverless (Lam

A Datacenter Scale Distributed Inference Serving Framework

Sandstorm is a self-hostable web productivity suite. It's im

Open-source implementation of AlphaEvolve

From a goal to a task DAG, automatically. TypeScript-native

IntentKit is an open-source, self-hosted cloud agent cluster

Google's open-source framework for building AI-powered appli

FlashInfer: Kernel Library for LLM Serving

Self-hosted AI agent orchestration platform: dispatch tasks,

Standardized Distributed Generative and Predictive AI Infere

Low-latency AI engine for mobile devices & wearables

A GPU cluster manager that configures and orchestrates infer

A Next-Generation Training Engine Built for Ultra-Large MoE

Open source voice AI platform. Self-hosted alternative to Va

Fast inference library for quantized LLMs optimized for sing

Modern, modular Stable Diffusion UI with ComfyUI integration

Harness LLMs with Multi-Agent Programming

A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local d

Personal AI Notebooks. Organize files & webpages and generat

Turn your PC, Mac, or Linux box into an AI server. LLM infe

The fastest local AI engine for Apple Silicon. 4.2x faster t

The simplest desktop client for OpenClaw 🦞 — bridge your Ag

Run Claude Code 100% on-device with local AI on Apple Silico

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveil

Fast LLM speculative inference server for consumer hardware.

Free, high-quality text-to-speech API endpoint to replace Op

On-device, real-time multimodal AI. Have natural voice and v

LM Studio TypeScript SDK

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRP

Mobile-native local AI Agent framework for phones and edge d

A simple, locally hosted Web Search MCP server for use with

Efficent platform for inference and serving local LLMs inclu

Open source, local, and self-hosted highly optimized languag

Voice AI runtime. Local first transcription, speaker diariza