vLLM is listed under Local LLM Runners, in the AI Models & Local Execution category on Flocci AI Tools. PagedAttention memory management for high-throughput multi-request GPU serving. It is free, with no paid plan attached, and it lives at github.com.
vLLM is listed as fully free — there is no paid tier attached to it in the catalog. That makes it one of the 115 entries on Flocci AI Tools with no upgrade path built in.
vLLM does 3 things the catalog singles out: Pagedattention memory management for high-throughput multi-request gpu serving; supports 200+ model architectures with an openai-compatible api server; originated at uc berkeley sky computing lab, now the de facto standard for self-hosted production llm serving.
AnythingLLM is the closest free alternative: it sits in the same Local LLM Runners sub-category and is free. GPT4All, Jan and KoboldCpp also start free. The full list is on the alternatives page.
See the full list →