ODS

ODS is a speech (TTS/STT) tool - Turn your PC, Mac, or Linux box into an AI server. LLM inference, chat UI, voice, agents, workflows, RAG, and image generation.

Overview

Turn your PC, Mac, or Linux box into a private AI server.

AI server and homelab setup is rapidly becoming a solved problem. It should feel that way for everyone.

No cloud required. No subscriptions required. Your prompts and data stay on your machine unless you choose otherwise. Cloud and hybrid API modes are optional when you want them.

Release validation: Operational changes are checked with a release-grade fleet and distro lab: zero-prereq bootstrap, fresh installs, product flows, full-model capabilities, lifecycle recovery, and the final User Green gate. See Release Validation for what a green run proves.

Repo layout: the repository root holds the public README, installers, security policy, GitHub workflows, and project coordination docs. The 'ods/' directory is the product runtime: services, installer phases, compose overlays, dashboard, CLI, tests, and operator docs.

Stable consumption: 'v2.5.2' is the current stable release. 'main' moves quickly; use it for active development and validation candidates. For forks, appliances, labs, or production-like installs, pin a tagged release or audited commit and keep your own validation receipt. Stable patch fixes land on 'release/2.5.x' before being merged forward. See Release Channels, Installer Trust, and Forkability.

Prefer to inspect before running or pin a release tag? See Installer Trust.

Windows users should use the PowerShell installer shown below or follow the Windows Quickstart.

ODS is open-source, written primarily in Shell, with 2,331 GitHub stars under the Apache 2.0 license. The latest release is v2.5.3 (2026-05-26).

Key capabilities

From the project's documentation:

• Local model inference — run open models on your own hardware
• ChatGPT-style web UI — talk to your models from any browser
• Control dashboard — manage models, services, setup, GPU status, and extensions from one place
• Voice, agents, and workflows — build automations that can listen, speak, call tools, and get work done
• RAG and search — connect local documents, private search, and retrieval workflows
• Image generation — run local image tools without sending prompts to a hosted API

Install

A quick way to get started (always check the official docs for the latest):

curl -fsSL https://raw.githubusercontent.com/Light-Heart-Labs/ODS/main/ods/get-ods.sh | bash

How it fits a local-AI stack

ODS runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related speech (TTS/STT) tools in the directory:

• "cactus"
• "claude-code-local"
• "dograh"
• "DreamServer"

Sources

• Source code & docs: Light-Heart-Labs/ODS
• Official website: https://discord.gg/qGVygYada3

Stats from GitHub, 2026-06-29.