PolyStrata
Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Cod…
What it does
Core capabilities at a glance
- Anthropic API
- Cuda
- Gemma
- Gguf
- GLM
- Inference Engine
- Local LLM
- Mixture OF Experts
Deep dive
The full breakdown - performance, comparisons, and setup
PolyStrata
PolyStrata is a local inference server - Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
Overview
Run large AI models on your own PC Qwen3.8-Flash-Next, GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Flint, Qwen3.6, Clover, Ornith 1.5, Gemma 4, Tiel Coder, MiniCPM-V and Kolibri 1 · free and open source
Claude Code on Qwen3.6-35B-A3B UD-Q3_K_M, on the laptop with the 8 GB card, in real time: it adds a --json option to a small program, writes a test for it and runs the tests. The server had read Claude Code's system prompt when it started ( "warm_start": true ).
A voxel pagoda garden, 1 shot prompt running on an RTX 5070 with Strata (Qwen3.8-Flash-Next IQ3_S, 128K context) · full video (49 s)
PolyStrata runs large AI models on a normal PC, models that usually need a server. They chat, write code and work with your apps and coding agents. Nothing leaves your PC.
- Qwen3.8-Flash-Next on an NVIDIA or AMD graphics card with 12 GB or more, on Windows or Linux. It also reads pictures. Its engine is the Strata project's, unchanged.
PolyStrata is open-source, written primarily in C++, with 683 GitHub stars under the MIT license. The latest release is v0.1.45-poly.6 (2026-10-29).
Key capabilities
From the project's documentation:
- Qwen3.8-Flash-Next on an NVIDIA or AMD graphics card with
- GLM 5.3 Flash, the largest: a file of 79 to 114 GB, most of which stays in RAM.
- DeepSeek V4 Flash, a file of 91 GB, most of which stays in RAM too. Its memory of a
- Qwen3.6-35B-A3B, a file of 13 to 23 GB. It also reads pictures.
- Clover-35B-A3B-Preview by DiffuSpace, Qwen3.6-35B-A3B trained further to also write a
- Gemma 4 26B-A4B, a file of 11 to 17 GB. It also reads pictures.
How it fits a local-AI stack
PolyStrata runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related local inference servers in the directory:
Sources
- Source code & docs: VecSzn/PolyStrata
Stats from GitHub, 2026-10-30.
Frequently asked
Quick answers to common questions
What is PolyStrata?
PolyStrata is a inference-server tool for local AI workloads. Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Cod…
Is PolyStrata free and open source?
Yes, PolyStrata has 683 GitHub stars and is licensed under MIT. You can self-host it for free on linux, windows, web.
What platforms does PolyStrata support?
PolyStrata runs on linux, windows, web.
What hardware do I need for PolyStrata?
The hardware requirements depend on which models you run. Check our hardware directory for compatible GPUs and systems. PolyStrata has 683 GitHub stars and an active community.
Does PolyStrata support GPU acceleration?
PolyStrata supports GPU acceleration via CUDA, Metal, or Vulkan depending on your platform. For the best performance, pair it with an NVIDIA RTX 4090 or 5090.
What are the best alternatives to PolyStrata?
Popular alternatives include other inference-server tools in our directory. Browse our full collection at /tool for comparisons, community reviews, and benchmark data to find the right fit for your workflow.
How much does PolyStrata cost?
PolyStrata is free-open-source. It is completely free and open source to self-host.
Pairs well with
Complementary tools, models, and hardware