SGLang is listed under Local LLM Runners, in the AI Models & Local Execution category on Flocci AI Tools. RadixAttention for automatic prefix-cache reuse across requests. It is free, with no paid plan attached, and it lives at github.com.
SGLang is listed as fully free — there is no paid tier attached to it in the catalog. That makes it one of the 115 entries on Flocci AI Tools with no upgrade path built in.
SGLang does 3 things the catalog singles out: Radixattention for automatic prefix-cache reuse across requests; day-0 support for newly released open models (e.g. kimi k3) among the fastest of any runner; scales from single gpu to distributed multi-node clusters with speculative decoding.
AnythingLLM is the closest free alternative: it sits in the same Local LLM Runners sub-category and is free. GPT4All, Jan and KoboldCpp also start free. The full list is on the alternatives page.
See the full list →