Every Local AI for Developers - a curated directory of open-source, self-hostable AI tools for developers. Featuring Ollama, vLLM, LocalAI, Chroma, Milvus, n8n, Dify, and more.
Local AI for Developers
APIs, model serving, vector stores, and automation pipelines - all self-hosted, all open-source. Build AI-powered apps without sending data to the cloud.
Jump to
Top developer tools
Agno
Full-stack framework for building multi-modal AI agents with knowledge, memory, and tools.
AutoGPT
Autonomous AI agent that breaks down goals into sub-tasks, executes code, and iterates to completion.
Hermes Agent
Self-improving AI agent with persistent memory, built-in learning loop, and multi-platform messaging. By Nous Research.
Mastra
TypeScript agent framework with built-in model routing, agent memory, tools, and observability.
Open Interpreter
Natural language interface that lets LLMs run Python, JavaScript, and Shell code on your computer.
Semantic Kernel
Microsoft's SDK for integrating LLMs with C#, Python, and Java - enterprise-grade AI orchestration.
CrewAI
Framework for orchestrating role-based AI agents that collaborate to accomplish complex tasks.
Genkit
Google's open-source framework for building AI-powered applications with Firebase and Vertex AI.
LangChain
Framework for developing LLM-powered applications with composable chains, agents, and 500+ integrations.
Vercel AI SDK
Open-source TypeScript toolkit for building AI-powered UIs with streaming, tool calls, and multi-modal.
Axolotl
Streamlined fine-tuning framework for LLMs with YAML configs, supporting 100+ model architectures.
Haystack
Open-source NLP framework for building production-ready RAG pipelines and search systems.
Why build with local AI?
Zero API costs
Run inference on your own hardware. No per-token fees, no rate limits, no data leaving your network.
Full control
Fine-tune, quantize, and serve any open model. Swap models without changing your application code.
Open ecosystem
Every tool in our directory is open-source, self-hostable, and backed by active communities.