vLLM is listed under Local LLM Runners, in the AI Models & Local Execution category on Flocci AI Tools. PagedAttention memory management for high-throughput multi-request GPU serving. It is free, with no paid plan attached, and it lives at github.com.
vLLM is listed as fully free — there is no paid tier attached to it in the catalog. That makes it one of the 396 entries on Flocci AI Tools with no upgrade path built in.
vLLM needs to be installed or self-hosted — it doesn't run in a browser tab. It is available on the command line, self-hosting, an API and Linux.
vLLM does 3 things the catalog singles out: Pagedattention memory management for high-throughput multi-request gpu serving; supports 200+ model architectures with an openai-compatible api server; originated at uc berkeley sky computing lab, now the de facto standard for self-hosted production llm serving.
AnythingLLM is the closest free alternative: it sits in the same Local LLM Runners sub-category and is free. BitNet, exo and Google AI Edge Gallery also start free. The full list is on the alternatives page.
See the full list →