Flide social preview
inference-server455Apache 2.0

Flide

🔥🔥 The extremely fast inference engine for decision model

Updated Nov 12, 2026
Website GitHub Docs
Platforms
Pricing
free-open-source
Status
active
License
Apache 2.0

What it does

Core capabilities at a glance

  • AI Agents
  • Cuda
  • Decision Making
  • Deterministic Inference
  • Gemma
  • Inference Engine
  • JEV
  • KV Cache

Deep dive

The full breakdown - performance, comparisons, and setup

FlideLink to this section

Flide is a local inference server - 🔥🔥 The extremely fast inference engine for decision model.

OverviewLink to this section

Flide is fast inference infrastructure for Jev-style decision models. With exact state forking it is up to 9.5 times faster than vLLM and SGLang, and every answer is the one the model gives the question alone. It serves the Jev '/v1/systemone' API.

Flide is open-source, written primarily in Python, with 455 GitHub stars under the Apache 2.0 license. The latest release is v0.1.14 (2026-11-11).

InstallLink to this section

A quick way to get started (always check the official docs for the latest):

pip install flide torchvision

How it fits a local-AI stackLink to this section

Flide runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related local inference servers in the directory:

SourcesLink to this section

Stats from GitHub, 2026-11-12.

Frequently asked

Quick answers to common questions

What is Flide?

Flide is a inference-server tool for local AI workloads. 🔥🔥 The extremely fast inference engine for decision model

Is Flide free and open source?

Yes, Flide has 455 GitHub stars and is licensed under Apache 2.0. You can self-host it for free on .

What hardware do I need for Flide?

The hardware requirements depend on which models you run. Check our hardware directory for compatible GPUs and systems. Flide has 455 GitHub stars and an active community.

Does Flide support GPU acceleration?

Flide's GPU support depends on your specific setup. Check the documentation for details. For the best performance, pair it with an NVIDIA RTX 4090 or 5090.

What are the best alternatives to Flide?

Popular alternatives include other inference-server tools in our directory. Browse our full collection at /tool for comparisons, community reviews, and benchmark data to find the right fit for your workflow.

How much does Flide cost?

Flide is free-open-source. It is completely free and open source to self-host.

Pairs well with

Complementary tools, models, and hardware