Every option in the catalog for when you need to run a model on your own machine, fully offline — 12 local LLM runners, 12 of them free or freemium, with the pricing tier printed on every row.
Flocci AI Tools lists 12 of them, ordered free tiers first: AnythingLLM, GPT4All, Jan, KoboldCpp and llama.cpp. Every one of them is free or has a free tier. Each entry states what it uniquely does rather than a score.
11 on this page are marked fully free with no paid plan at all: AnythingLLM, GPT4All, Jan, KoboldCpp and llama.cpp. The remaining 1 are freemium, trial or paid, and each is labelled with its exact tier so nothing surprises you at sign-up.
Free tools first, then freemium, then trial, then paid, and alphabetically inside each tier. Nobody pays to appear higher: Flocci AI Tools carries no ads, no sponsored slots and no paid listings, so the order reflects price and nothing else.
| Tool | Pricing | Type | Listed for |
|---|---|---|---|
| AnythingLLM | Free | Local LLM Runners | All-in-one local RAG and agents app |
| GPT4All | Free | Local LLM Runners | Private local chat with your documents |
| Jan | Free | Local LLM Runners | Open-source, offline ChatGPT alternative |
| KoboldCpp | Free | Local LLM Runners | Ships as a single portable executable with a bundled web UI (KoboldAI Lite) |
| llama.cpp | Free | Local LLM Runners | Pure C/C++ inference engine with minimal dependencies, runs on CPU-only hardware |
| LM Studio | Free | Local LLM Runners | Polished desktop GUI for local models |
| MLX-LM (Apple) | Free | Local LLM Runners | Purpose-built for Apple Silicon's unified memory architecture, faster than llama.cpp for many models on Mac |
| Ollama | Free | Local LLM Runners | The default way to run LLMs locally |
| Open WebUI | Free | Local LLM Runners | Self-hosted ChatGPT-style interface |
| SGLang | Free | Local LLM Runners | RadixAttention for automatic prefix-cache reuse across requests |
| vLLM | Free | Local LLM Runners | PagedAttention memory management for high-throughput multi-request GPU serving |
| Msty | Freemium | Local LLM Runners | Nexus module: unified gateway for managing model connections, credentials and usage policy across providers |