# The best free local LLM runners Every option in the catalog for when you need to run a model on your own machine, fully offline — 19 local LLM runners, 19 of them free or freemium, with the pricing tier printed on every row. ## Stats - 19 tools listed - 19 free or freemium - 18 with no paid plan at all - 1 sub-categories covered ## FAQ ### What are the best free local LLM runners? Flocci AI Tools lists 19 of them, ordered free tiers first: AnythingLLM, BitNet, exo, Google AI Edge Gallery and GPT4All. Every one of them is free or has a free tier. Each entry states what it uniquely does rather than a score. ### Which of these are completely free? 18 on this page are marked fully free with no paid plan at all: AnythingLLM, BitNet, exo, Google AI Edge Gallery and GPT4All. The remaining 1 are freemium, trial or paid, and each is labelled with its exact tier so nothing surprises you at sign-up. ### How is this list ordered? Free tools first, then freemium, then trial, then paid, and alphabetically inside each tier. Nobody pays to appear higher: Flocci AI Tools carries no ads, no sponsored slots and no paid listings, so the order reflects price and nothing else. ## Quick picks ### Which local LLM runners have a mobile app? AnythingLLM, Google AI Edge Gallery, KoboldCpp, MediaPipe (Google AI Edge) and MLC LLM have an iOS or Android app. 5 of the 19 free local LLM runners here can run on your phone. ### Which local LLM runners can you self-host or run offline? AnythingLLM, BitNet, exo, Google AI Edge Gallery and GPT4All can be self-hosted or run locally without a browser — useful for privacy, air-gapped networks, or avoiding API rate limits. 16 of the 19 free local LLM runners here run offline. ## Tools - [AnythingLLM](https://aitools.flocci.in/tool/anythingllm) — Free — All-in-one local RAG and agents app - [BitNet](https://aitools.flocci.in/tool/bitnet) — Free — Official inference framework for 1-bit (ternary) LLMs - [exo](https://aitools.flocci.in/tool/exo) — Free — Links everyday devices (Macs, PCs, phones) into one cluster to run models too large for a single machine - [Google AI Edge Gallery](https://aitools.flocci.in/tool/google-ai-edge-gallery) — Free — Runs Gemma models fully on-device on Android and iOS, offline after one model download - [GPT4All](https://aitools.flocci.in/tool/gpt4all) — Free — Private local chat with your documents - [Jan](https://aitools.flocci.in/tool/jan) — Free — Open-source, offline ChatGPT alternative - [KoboldCpp](https://aitools.flocci.in/tool/koboldcpp) — Free — Ships as a single portable executable with a bundled web UI (KoboldAI Lite) - [llama.cpp](https://aitools.flocci.in/tool/llama-cpp) — Free — Pure C/C++ inference engine with minimal dependencies, runs on CPU-only hardware - [llamafile](https://aitools.flocci.in/tool/llamafile) — Free — Packs model weights and runtime into one executable that runs on macOS, Windows and Linux - [LM Studio](https://aitools.flocci.in/tool/lm-studio) — Free — Polished desktop GUI for local models - [LocalAI](https://aitools.flocci.in/tool/localai) — Free — Drop-in OpenAI-compatible API server running models on your own hardware, CPU or GPU - [MediaPipe (Google AI Edge)](https://aitools.flocci.in/tool/mediapipe-google-ai-edge) — Free — Cross-platform on-device ML for vision, audio, text and LLM inference - [MLC LLM](https://aitools.flocci.in/tool/mlc-llm) — Free — Compiles and runs LLMs natively on iOS, Android, browsers (WebGPU), Mac, Windows and Linux - [MLX-LM (Apple)](https://aitools.flocci.in/tool/mlx-lm-apple) — Free — Purpose-built for Apple Silicon's unified memory architecture, faster than llama.cpp for many models on Mac - [Ollama](https://aitools.flocci.in/tool/ollama) — Free — The default way to run LLMs locally - [Open WebUI](https://aitools.flocci.in/tool/open-webui) — Free — Self-hosted ChatGPT-style interface - [SGLang](https://aitools.flocci.in/tool/sglang) — Free — RadixAttention for automatic prefix-cache reuse across requests - [vLLM](https://aitools.flocci.in/tool/vllm) — Free — PagedAttention memory management for high-throughput multi-request GPU serving - [Msty](https://aitools.flocci.in/tool/msty) — Freemium — Nexus module: unified gateway for managing model connections, credentials and usage policy across providers --- Source: Flocci AI Tools — https://aitools.flocci.in/best/best-local-llm-runners Facts last verified: October 2026