StartLux-Decision social preview
inference-server1,622Apache 2.0

StartLux-Decision

Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp…

Updated Oct 31, 2026
Website GitHub
Platforms
Pricing
free-open-source
Status
active
License
Apache 2.0

What it does

Core capabilities at a glance

  • Agents
  • Calibration
  • Classification
  • Decision Making
  • Gguf
  • Inference
  • Llama CPP
  • MLX

Deep dive

The full breakdown - performance, comparisons, and setup

StartLux-Decision

StartLux-Decision is an agent framework - Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp and MLX.

Overview

StartLux-Decision is a family of open decision models. Given a state (text, JSON or images) and a set of typed questions, a model returns a probability for every option of every question: a choice among listed options ('choice'), a yes or no judgement ('noul'), or a level on a scale ('score'). Instant models answer in a single forward pass with bidirectional attention over the prompt. AutoThink models answer in one pass when the top probability reaches a gate, 0.6 by default, and otherwise generate a short reasoning trace and read the answer again.

This repository contains the inference engine and HTTP server for both variants. The API is compatible with System One '/v1/systemone'.

Helicopter rescue: calls each stage of a Coast Guard hoist rescue in Hurricane Harvey, one frame a second Chess: with White, checkmates Jev 1.13 on move 19 of a Scotch Game, and neither side searches

Super Mario Bros.: clears World 1-1 StarCraft II: makes the strategic calls for a Terran bot and beats the built-in Hard AI

StartLux-Decision is open-source, written primarily in Python, with 1,622 GitHub stars under the Apache 2.0 license. The latest release is v1.1.0 (2026-10-14).

Key capabilities

From the project's documentation:

  • 2026-10-16: StartLux-Decision v1.1 27B Instant ranks first of 174 entries on the
  • 2026-10: the technical report is on arXiv as 2610.17309.

Install

A quick way to get started (always check the official docs for the latest):

pip install -r requirements.txt # PyTorch 2.14.1 for CUDA 13, Triton, nvcc 13.0

How it fits a local-AI stack

StartLux-Decision runs on your own hardware, so pair it with a model and a GPU sized to your needs. Use the VRAM calculator to pick a model that fits your card, and see what you can run for hardware guidance. Related agent frameworks in the directory:

Sources

Stats from GitHub, 2026-10-30.

Frequently asked

Quick answers to common questions

What is StartLux-Decision?

StartLux-Decision is a inference-server tool for local AI workloads. Open decision models from 0.8B to 27B: a calibrated probability for every option in one pass, and a short thought only when unsure. Engine for vLLM, llama.cpp…

Is StartLux-Decision free and open source?

Yes, StartLux-Decision has 1,622 GitHub stars and is licensed under Apache 2.0. You can self-host it for free on .

What hardware do I need for StartLux-Decision?

The hardware requirements depend on which models you run. Check our hardware directory for compatible GPUs and systems. StartLux-Decision has 1,622 GitHub stars and an active community.

Does StartLux-Decision support GPU acceleration?

StartLux-Decision's GPU support depends on your specific setup. Check the documentation for details. For the best performance, pair it with an NVIDIA RTX 4090 or 5090.

What are the best alternatives to StartLux-Decision?

Popular alternatives include other inference-server tools in our directory. Browse our full collection at /tool for comparisons, community reviews, and benchmark data to find the right fit for your workflow.

How much does StartLux-Decision cost?

StartLux-Decision is free-open-source. It is completely free and open source to self-host.

Pairs well with

Complementary tools, models, and hardware