Ollama
Local LLM Runners
- The default way to run LLMs locally
- One command to run Llama, Qwen, DeepSeek…
- OpenAI-compatible local API
- Free and open-source
AI Models & Local Execution (19)
19 free local LLM runners and 0 more — pricing tier and real capabilities on every entry. No ads, no sponsored placement.
AllLocal LLM RunnersModel Hosting & Inference APIsNotable Open ModelsSpeech & Transcription EnginesFine-Tuning & Training FrameworksLLM Eval & ObservabilityLeaderboards & BenchmarksRobotics & Embodied AI
free
LM Studio
Local LLM Runners
- Polished desktop GUI for local models
- Discover, download and chat with GGUF models
- Local server with OpenAI-compatible API
- Free for personal use
Jan
Local LLM Runners
- Open-source, offline ChatGPT alternative
- No-config, privacy-first GUI
- Runs fully on your device
- Free forever
GPT4All
Local LLM Runners
- Private local chat with your documents
- Runs on modest laptops
- LocalDocs RAG built in
- Free and open-source
Open WebUI
Local LLM Runners
- Self-hosted ChatGPT-style interface
- Works with Ollama and OpenAI-compatible APIs
- RAG, tools and multi-user
- Free and open-source
AnythingLLM
Local LLM Runners
- All-in-one local RAG and agents app
- Chat with your docs privately
- Works with local or cloud models
- Free and open-source
llama.cpp
Local LLM Runners
- Pure C/C++ inference engine with minimal dependencies, runs on CPU-only hardware
- Powers the GGUF format used by Ollama, LM Studio and most local runners under the hood
- Broad quantization support (2-bit to 8-bit) for running large models on consumer hardware
vLLM
Local LLM Runners
- PagedAttention memory management for high-throughput multi-request GPU serving
- Supports 200+ model architectures with an OpenAI-compatible API server
- Originated at UC Berkeley Sky Computing Lab, now the de facto standard for self-hosted production LLM serving
SGLang
Local LLM Runners
- RadixAttention for automatic prefix-cache reuse across requests
- Day-0 support for newly released open models (e.g. Kimi K3) among the fastest of any runner
- Scales from single GPU to distributed multi-node clusters with speculative decoding
KoboldCpp
Local LLM Runners
- Ships as a single portable executable with a bundled web UI (KoboldAI Lite)
- Generates text, image, video and speech from one local app
- Runs on CPU or GPU with no installation required
MLX-LM (Apple)
Local LLM Runners
- Purpose-built for Apple Silicon's unified memory architecture, faster than llama.cpp for many models on Mac
- Built-in LoRA/QLoRA fine-tuning support, not just inference
- Direct Hugging Face Hub integration for pulling and pushing quantized models
Msty
Local LLM Runners
- Nexus module: unified gateway for managing model connections, credentials and usage policy across providers
- Governance features (SSO, audit logs, zero telemetry) aimed at private/enterprise use
- Combines local model chat, agents (Go), and knowledge packages (Stack) in one app
- Runs Gemma models fully on-device on Android and iOS, offline after one model download
- Chat, image questions, audio transcription and prompt lab
- No account or Google login required
- Open-source app from the Google AI Edge team
- Official inference framework for 1-bit (ternary) LLMs
- Fast lossless CPU inference with low energy use
- Runs large models on laptops without a GPU
- MIT-licensed open source
- Cross-platform on-device ML for vision, audio, text and LLM inference
- Ready-made pose, face, hand and object tasks
- Runs in browser, Android, iOS and desktop
- Free and open source
- Packs model weights and runtime into one executable that runs on macOS, Windows and Linux
- Built on llama.cpp with a bundled local web UI and OpenAI-compatible server
- Mozilla-backed, no install or account needed
- Drop-in OpenAI-compatible API server running models on your own hardware, CPU or GPU
- Covers text, image, audio and embeddings in one server
- MIT licensed with multi-user support
- Links everyday devices (Macs, PCs, phones) into one cluster to run models too large for a single machine
- Automatic device discovery and model partitioning
- Apache-2.0 open source
- Compiles and runs LLMs natively on iOS, Android, browsers (WebGPU), Mac, Windows and Linux
- OpenAI-compatible server engine
- Apache-2.0
Local LLM Runners — straight answers
What are the best free local LLM runners?
Flocci AI Tools lists 19 local LLM runners, ordered free tiers first: AnythingLLM, BitNet, exo, Google AI Edge Gallery and GPT4All. All of them are free or have a free tier. Every entry states what it uniquely does, not a score.
Are there completely free local LLM runners?
Yes — 18 of these are marked fully free with no paid plan attached: AnythingLLM, BitNet, exo, Google AI Edge Gallery and GPT4All. The rest are freemium, trial or paid, and each row states which.
What should I look for in local LLM runners?
Start with what you need to do: run a model on your own machine, fully offline. Then check the pricing tier, because "free" here means no paid plan at all while "freemium" means a free tier under paid plans. Every tool on this page lists both.
See the full list →Head-to-head comparisons
AnythingLLM vs BitNetAnythingLLM vs exoAnythingLLM vs Google AI Edge GalleryAnythingLLM vs GPT4AllAnythingLLM vs JanBitNet vs exoBitNet vs Google AI Edge GalleryBitNet vs GPT4All
Free alternatives
Ollama alternativesLM Studio alternativesJan alternativesGPT4All alternativesOpen WebUI alternativesAnythingLLM alternativesllama.cpp alternativesvLLM alternatives
Looking for a ranked shortlist instead? See the best free local LLM runners.