experiential

experiential is a model router/gateway - Experiential is the open source, zero markup gateway for BYOK, self-hosted and 1000+ marketplace models. It learns from your traffic to cut costs, recommend better models, and train a specialized model you own.

Overview

1. Use hosted, BYOK, and local models through one OpenAI-compatible API. 2. Control which users and agents can use which models, for which use cases, and how much they can spend. 3. Turn production traffic into a custom router or model optimized for quality, speed, and cost.

Start a local OpenAI-compatible gateway. On first run, the setup wizard uses the shared provider, model, and reasoning-effort selectors, persists every selected provider connection, then shows defaults for the public alias, identity, and '$50.00' command budget before printing a one-time key:

Prefer a managed gateway to running one locally? The hosted platform at platform.experientiallabs.ai serves the same OpenAI-compatible (and Anthropic Messages) API at 'https://api.experientiallabs.ai/v1'. See SETUP.md for copy-paste prompts you hand to your coding agent (Claude Code, Cursor, Codex, and similar); the agent runs the setup for you. It collects four prompts:

experiential is open-source, written primarily in Python, with 14,017 GitHub stars under the Apache 2.0 license. The latest release is v0.7.223 (2026-10-28).

Install

A quick way to get started (always check the official docs for the latest):

pip install experiential

How it fits a local-AI stack

experiential runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related model router/gateways in the directory:

• "AIClient2API"
• "ClawRouter"
• "litellm"
• "olla"

Sources

• Source code & docs: experientiallabs/experiential
• Official website: https://experientiallabs.ai

Stats from GitHub, 2026-10-30.