Open-Source & Locally-Run AI Tools (69)

Weights you can download, runtimes you can install and frameworks you can read — for privacy, cost control, or just not wanting a dependency on someone's API.

69tools listed
67free or freemium
50with no paid plan at all
18sub-categories covered

Open-Source & Locally-Run AI Tools — straight answers

What are the best free Open-Source & Locally-Run AI Tools?

Flocci AI Tools lists 69 of them, ordered free tiers first: Agno, Aider, AnythingLLM, AWS Strands Agents and Cline. 67 of the 69 are free or have a free tier. Each entry states what it uniquely does rather than a score.

Which of these are completely free?

50 on this page are marked fully free with no paid plan at all: Agno, Aider, AnythingLLM, AWS Strands Agents and Cline. The remaining 19 are freemium, trial or paid, and each is labelled with its exact tier so nothing surprises you at sign-up.

How is this list ordered?

Free tools first, then freemium, then trial, then paid, and alphabetically inside each tier. Nobody pays to appear higher: Flocci AI Tools carries no ads, no sponsored slots and no paid listings, so the order reflects price and nothing else.

All 69 tools, free tiers first

Open-Source & Locally-Run AI Tools: pricing tier, category and the capability each tool is listed for.
ToolPricingTypeListed for
AgnoFreeAgent Frameworks (Developers)Open-source (Apache-2.0) Python framework, 41.7k GitHub stars
AiderFreeTerminal & CLI AgentsOpen-source AI pair programmer in your terminal
AnythingLLMFreeLocal LLM RunnersAll-in-one local RAG and agents app
AWS Strands AgentsFreeAgent Frameworks (Developers)Open-source (6,800+ stars) Python and TypeScript SDK from AWS
ClineFreeTerminal & CLI AgentsOpen-source autonomous coding agent for VS Code
DeepSeek ModelsFreeNotable Open ModelsOpen V3-series and R1 reasoning models
DSPyFreeAgent Frameworks (Developers)Open-source (MIT) framework from Stanford NLP, 37k+ GitHub stars
EXAONE (LG AI Research)FreeNotable Open ModelsEXAONE 4.5: LG's first open-weight vision-language model for industrial use cases
Falcon (TII)FreeNotable Open ModelsFalcon H1 hybrid transformer-Mamba architecture for efficient long-context inference
Gemma (Google)FreeNotable Open ModelsGoogle's lightweight open models (Gemma 4)
Google Agent Development Kit (ADK)FreeAgent Frameworks (Developers)Open-source Python/Java framework from Google for building multi-agent systems
GPT-OSS (OpenAI)FreeNotable Open ModelsOpenAI's open-weight reasoning models
GPT4AllFreeLocal LLM RunnersPrivate local chat with your documents
HuggingChatFreeGeneral Purpose ChatbotsCompletely free and open-source
Hunyuan (Tencent)FreeNotable Open ModelsOpen-weight large text MoE models (Hunyuan A13B/Hy3 series) with permissive commercial license
IBM GraniteFreeNotable Open ModelsApache 2.0 licensed enterprise-grade model family
JanFreeLocal LLM RunnersOpen-source, offline ChatGPT alternative
KimiFreeGeneral Purpose ChatbotsFree access to Kimi K2-series agentic models
KoboldCppFreeLocal LLM RunnersShips as a single portable executable with a bundled web UI (KoboldAI Lite)
LangGraphFreeAgent Frameworks (Developers)Build stateful, multi-agent apps as graphs
Llama (Meta)FreeNotable Open ModelsMeta's flagship open-weight family (Llama 4)
llama.cppFreeLocal LLM RunnersPure C/C++ inference engine with minimal dependencies, runs on CPU-only hardware
LM StudioFreeLocal LLM RunnersPolished desktop GUI for local models
MastraFreeAgent Frameworks (Developers)Open-source TypeScript framework (Apache 2.0) for agents, workflows and RAG
Microsoft AutoGenFreeAgent Frameworks (Developers)Multi-agent conversation framework
MiniMax M2 (open weights)FreeNotable Open ModelsOpen-weight MoE text/reasoning model line distinct from MiniMax's Hailuo video product already listed
Mistral Open Models (Magistral, Devstral, Voxtral)FreeNotable Open ModelsDevstral: open coding-agent model tuned for SWE-bench-style tasks
MLX-LM (Apple)FreeLocal LLM RunnersPurpose-built for Apple Silicon's unified memory architecture, faster than llama.cpp for many models on Mac
MorphicFreeAI Search & Answer EnginesOpen-source, Apache 2.0, self-hostable generative-UI search engine
Nemotron (NVIDIA)FreeNotable Open ModelsNVIDIA's open post-trained/distilled model family built on Llama and NVIDIA's own architectures
NVIDIA ParakeetFreeSpeech & Transcription EnginesTops the Hugging Face Open ASR Leaderboard with 6.05% average WER at 0.6B params
OllamaFreeLocal LLM RunnersThe default way to run LLMs locally
OLMo (Ai2)FreeNotable Open ModelsOnly major model family shipping full pretraining data (Dolma), code and intermediate checkpoints, not just weights
Open WebUIFreeLocal LLM RunnersSelf-hosted ChatGPT-style interface
OpenAI Agents SDKFreeAgent Frameworks (Developers)Lightweight agent orchestration from OpenAI
OpenAI WhisperFreeSpeech & Transcription EnginesOpen-source speech-to-text, run locally free
OpenHandsFreeAutonomous Coding AgentsSelf-hosted control center for coding agents with GUI, CLI and SDK surfaces
PerplexicaFreeAI Search & Answer EnginesMIT-licensed, fully self-hostable open-source Perplexity clone
Phi (Microsoft)FreeNotable Open ModelsMIT-licensed small language models optimized for on-device and edge deployment
PleiasFreeNotable Open ModelsFully open-weight, open-dataset small language models (350M-3B) explicitly built for EU AI Act compliance
Pydantic AIFreeAgent Frameworks (Developers)Type-safe Python agent framework from the Pydantic team, validated structured outputs
Qwen (Alibaba)FreeNotable Open ModelsState-of-the-art open MoE models (Qwen3.x)
Qwen ChatFreeGeneral Purpose ChatbotsFree access to Qwen3-series models
RiffusionFreeAI Music & AudioFree, unlimited song generation
SGLangFreeLocal LLM RunnersRadixAttention for automatic prefix-cache reuse across requests
smolagentsFreeAgent Frameworks (Developers)Extremely minimal open-source library (~1,000 lines) from Hugging Face
Stable Diffusion (Stability AI)FreeAI Image GenerationOpen-source, run locally for unlimited free use
Vanna AIFreeAI Database & SQL CopilotsFully open-source text-to-SQL agent, self-hostable with no vendor lock-in
vLLMFreeLocal LLM RunnersPagedAttention memory management for high-throughput multi-request GPU serving
WhisperXFreeSpeech & Transcription Engines70x real-time transcription speed via batched inference on top of Whisper
AssemblyAIFreemiumSpeech & Transcription EnginesSpeech-to-text with audio intelligence
CrewAIFreemiumAgent Frameworks (Developers)Role-based multi-agent 'crews'
DeepgramFreemiumSpeech & Transcription EnginesFast, accurate speech-to-text API
DeepSeekFreemiumGeneral Purpose ChatbotsFree access to V3-series & R1 reasoning models
DyadFreemiumApp Builders & Vibe CodingFully open-source, runs locally on your machine with offline capability
ElevenLabs ScribeFreemiumSpeech & Transcription EnginesScribe v2 Realtime transcribes in under 150ms latency
FLUX (Black Forest Labs)FreemiumAI Image GenerationOpen-weight models you can run locally for free
GLM (Z.ai)FreemiumNotable Open ModelsGLM-4.5-Flash and GLM-4.7-Flash text models are free via API
LlamaIndexFreemiumAgent Frameworks (Developers)Leading framework for RAG and data agents
Mistral OCR 4FreemiumAI OCR & Document ExtractionSelf-hostable single-container OCR model for regulated industries
Mistral VoxtralFreemiumSpeech & Transcription EnginesApache 2.0 open-weight models (24B and 3B) downloadable from Hugging Face
MstyFreemiumLocal LLM RunnersNexus module: unified gateway for managing model connections, credentials and usage policy across providers
n8nFreemiumWorkflow AutomationOpen-source, self-hostable automation
ObsidianFreemiumAI Note-Taking & DocsLocal-first markdown knowledge base
SonioxFreemiumSpeech & Transcription EnginesReal-time speech-to-text priced well under typical competitor rates
SpeechmaticsFreemiumSpeech & Transcription EnginesFree starting credit with no card required, 56+ language support
TabnineFreemiumCode Autocomplete & AssistantsPrivacy-first completions (can run air-gapped)
LokaliseTrialTranslation & Language AIContext-aware AI translation with multi-LLM smart routing across providers
Claude CoworkGeneral Autonomous AgentsRuns in the Claude desktop app (Mac/Windows)

Agno

Agent Frameworks (Developers)
free
  • Open-source (Apache-2.0) Python framework, 41.7k GitHub stars
  • AgentOS: FastAPI-based production runtime for deploying agents
  • Control-plane UI for monitoring live agent systems across clouds

Aider

Terminal & CLI Agents
free
  • Open-source AI pair programmer in your terminal
  • Git-aware commits and edits
  • Works with any model (bring your key)
  • Free to use

AnythingLLM

Local LLM Runners
free
  • All-in-one local RAG and agents app
  • Chat with your docs privately
  • Works with local or cloud models
  • Free and open-source

AWS Strands Agents

Agent Frameworks (Developers)
free
  • Open-source (6,800+ stars) Python and TypeScript SDK from AWS
  • Steering handlers/hooks that catch agent mistakes before execution
  • Native Bedrock and AWS AgentCore integration, plus any-LLM support

Cline

Terminal & CLI Agents
free
  • Open-source autonomous coding agent for VS Code
  • Plan/Act modes with approvals
  • Bring your own API key or model
  • MCP tool support

DeepSeek Models

Notable Open Models
free
  • Open V3-series and R1 reasoning models
  • Efficient MoE, low-cost inference
  • Strong math and code
  • Free open weights

DSPy

Agent Frameworks (Developers)
free
  • Open-source (MIT) framework from Stanford NLP, 37k+ GitHub stars
  • Compiles/optimizes prompts automatically against metrics instead of manual prompt tuning
  • Production use at Databricks, Shopify, Dropbox, AWS; Shopify reports ~550x cost reduction

EXAONE (LG AI Research)

Notable Open Models
free
  • EXAONE 4.5: LG's first open-weight vision-language model for industrial use cases
  • 33B flagship plus FP8/AWQ quantized variants for efficient local deployment
  • Backed by LG's enterprise/manufacturing domain tuning

Falcon (TII)

Notable Open Models
free
  • Falcon H1 hybrid transformer-Mamba architecture for efficient long-context inference
  • Falcon Mamba: pure state-space model variant, no attention layers
  • Free commercial use under TII's permissive open license

Gemma (Google)

Notable Open Models
free
  • Google's lightweight open models (Gemma 4)
  • Runs in as little as 16GB RAM
  • On-device and multimodal variants
  • Free and open

Google Agent Development Kit (ADK)

Agent Frameworks (Developers)
free
  • Open-source Python/Java framework from Google for building multi-agent systems
  • Native integration with Vertex AI Agent Engine and Gemini models
  • Model-agnostic — works with non-Google LLMs via LiteLLM

GPT-OSS (OpenAI)

Notable Open Models
free
  • OpenAI's open-weight reasoning models
  • Run locally or self-host
  • Configurable reasoning effort
  • Free, permissive license

GPT4All

Local LLM Runners
free
  • Private local chat with your documents
  • Runs on modest laptops
  • LocalDocs RAG built in
  • Free and open-source

HuggingChat

General Purpose Chatbots
free
  • Completely free and open-source
  • Switch between top open models (Llama, Qwen, DeepSeek…)
  • Web search and tools enabled
  • Community assistants

Hunyuan (Tencent)

Notable Open Models
free
  • Open-weight large text MoE models (Hunyuan A13B/Hy3 series) with permissive commercial license
  • Hunyuan3D line for fast image-to-3D generation (under 1 second)
  • Hy-MT translation models covering dozens of language pairs

IBM Granite

Notable Open Models
free
  • Apache 2.0 licensed enterprise-grade model family
  • Hybrid Mamba/transformer architecture (Granite 4) for lower memory footprint
  • Built-in focus on governance, provenance and enterprise compliance

Jan

Local LLM Runners
free
  • Open-source, offline ChatGPT alternative
  • No-config, privacy-first GUI
  • Runs fully on your device
  • Free forever

Kimi

General Purpose Chatbots
free
  • Free access to Kimi K2-series agentic models
  • Excellent long-document understanding
  • Open weights, strong on agentic tasks
  • Built-in research and browsing

KoboldCpp

Local LLM Runners
free
  • Ships as a single portable executable with a bundled web UI (KoboldAI Lite)
  • Generates text, image, video and speech from one local app
  • Runs on CPU or GPU with no installation required

LangGraph

Agent Frameworks (Developers)
free
  • Build stateful, multi-agent apps as graphs
  • Human-in-the-loop and durable execution
  • Works with any LLM
  • Open-source with a hosted platform

Llama (Meta)

Notable Open Models
free
  • Meta's flagship open-weight family (Llama 4)
  • Multimodal and long-context variants
  • Run locally or via any host
  • Free, permissive license

llama.cpp

Local LLM Runners
free
  • Pure C/C++ inference engine with minimal dependencies, runs on CPU-only hardware
  • Powers the GGUF format used by Ollama, LM Studio and most local runners under the hood
  • Broad quantization support (2-bit to 8-bit) for running large models on consumer hardware

LM Studio

Local LLM Runners
free
  • Polished desktop GUI for local models
  • Discover, download and chat with GGUF models
  • Local server with OpenAI-compatible API
  • Free for personal use

Mastra

Agent Frameworks (Developers)
free
  • Open-source TypeScript framework (Apache 2.0) for agents, workflows and RAG
  • Drops directly into existing React/Next.js apps or runs standalone
  • Built-in workflow engine with suspend/resume and human-in-the-loop steps

Microsoft AutoGen

Agent Frameworks (Developers)
free
  • Multi-agent conversation framework
  • Event-driven, async agent design
  • Studio UI for prototyping
  • Fully open-source

MiniMax M2 (open weights)

Notable Open Models
free
  • Open-weight MoE text/reasoning model line distinct from MiniMax's Hailuo video product already listed
  • Actively iterated through 2026 (M2.1, M2.5, M2.7 checkpoints)
  • Competitive on agentic coding and tool-use benchmarks among open Chinese models

MLX-LM (Apple)

Local LLM Runners
free
  • Purpose-built for Apple Silicon's unified memory architecture, faster than llama.cpp for many models on Mac
  • Built-in LoRA/QLoRA fine-tuning support, not just inference
  • Direct Hugging Face Hub integration for pulling and pushing quantized models

Morphic

AI Search & Answer Engines
free
  • Open-source, Apache 2.0, self-hostable generative-UI search engine
  • 9k+ GitHub stars, actively maintained
  • Pluggable model (OpenAI/Anthropic/Gemini/Ollama) and search backends (Tavily/Brave/Exa)

Nemotron (NVIDIA)

Notable Open Models
free
  • NVIDIA's open post-trained/distilled model family built on Llama and NVIDIA's own architectures
  • Includes top-ranked open embedding models (Nemotron Embed, Llama-Embed-Nemotron)
  • OpenReasoning-Nemotron: distilled reasoning models for local/edge inference

NVIDIA Parakeet

Speech & Transcription Engines
free
  • Tops the Hugging Face Open ASR Leaderboard with 6.05% average WER at 0.6B params
  • CC-BY-4.0 license, free for commercial and non-commercial use
  • RTFx ~3,386 — extremely fast inference relative to accuracy

Ollama

Local LLM Runners
free
  • The default way to run LLMs locally
  • One command to run Llama, Qwen, DeepSeek…
  • OpenAI-compatible local API
  • Free and open-source

OLMo (Ai2)

Notable Open Models
free
  • Only major model family shipping full pretraining data (Dolma), code and intermediate checkpoints, not just weights
  • Olmo 3 ships Base, Think, and Instruct variants at 7B/32B
  • OlmoCore training framework and Open Instruct pipeline are also open source

Open WebUI

Local LLM Runners
free
  • Self-hosted ChatGPT-style interface
  • Works with Ollama and OpenAI-compatible APIs
  • RAG, tools and multi-user
  • Free and open-source

OpenAI Agents SDK

Agent Frameworks (Developers)
free
  • Lightweight agent orchestration from OpenAI
  • Agent handoffs, guardrails and tracing
  • Tool and function calling built in
  • Open-source, pay only for model usage

OpenAI Whisper

Speech & Transcription Engines
free
  • Open-source speech-to-text, run locally free
  • 99+ languages and translation
  • Robust to accents and noise
  • Powers countless apps

OpenHands

Autonomous Coding Agents
free
  • Self-hosted control center for coding agents with GUI, CLI and SDK surfaces
  • Enterprise deployment controls over models, data access and auditability
  • MIT licensed, 83.9k GitHub stars, very active commit history

Perplexica

AI Search & Answer Engines
free
  • MIT-licensed, fully self-hostable open-source Perplexity clone
  • Runs with local LLMs via Ollama or cloud providers
  • Uses SearxNG for private, ad-free web search

Phi (Microsoft)

Notable Open Models
free
  • MIT-licensed small language models optimized for on-device and edge deployment
  • Phi-4-mini and Phi-4-multimodal handle text, vision and audio in one small model
  • Distributed via Azure AI Foundry, Hugging Face, and Ollama

Pleias

Notable Open Models
free
  • Fully open-weight, open-dataset small language models (350M-3B) explicitly built for EU AI Act compliance
  • Trained exclusively on the 2-trillion-token open Common Corpus, not scraped/licensed text
  • Purpose-built RAG models (Pleias-RAG-350M/1B) with built-in citation tracking, Apache 2.0 licensed

Pydantic AI

Agent Frameworks (Developers)
free
  • Type-safe Python agent framework from the Pydantic team, validated structured outputs
  • Model-agnostic (OpenAI, Anthropic, Gemini, Groq, Mistral, local)
  • Built-in dependency injection and streaming; pairs with Pydantic Logfire for observability

Qwen (Alibaba)

Notable Open Models
free
  • State-of-the-art open MoE models (Qwen3.x)
  • Top-tier coding and multilingual skills
  • Runs on a single high-RAM Mac
  • Free open weights

Qwen Chat

General Purpose Chatbots
free
  • Free access to Qwen3-series models
  • Strong multilingual and coding performance
  • Open weights you can also run locally
  • Vision, web search and artifacts

Riffusion

AI Music & Audio
free
  • Free, unlimited song generation
  • Open-source roots
  • Vocals and instrumentals
  • No credit card required

SGLang

Local LLM Runners
free
  • RadixAttention for automatic prefix-cache reuse across requests
  • Day-0 support for newly released open models (e.g. Kimi K3) among the fastest of any runner
  • Scales from single GPU to distributed multi-node clusters with speculative decoding

smolagents

Agent Frameworks (Developers)
free
  • Extremely minimal open-source library (~1,000 lines) from Hugging Face
  • CodeAgent paradigm: agents write actions as executable code, not JSON
  • Model-agnostic and modality-agnostic (text, vision, audio) with sandboxed execution via E2B/Docker/Modal
free
  • Open-source, run locally for unlimited free use
  • Huge ecosystem of models and LoRAs
  • ControlNet for precise composition
  • Foundation of countless AI art tools

Vanna AI

AI Database & SQL Copilots
free
  • Fully open-source text-to-SQL agent, self-hostable with no vendor lock-in
  • Multi-turn conversational querying across Postgres, Snowflake, BigQuery, MySQL, SQLite and more
  • Agent memory (hosted vector DB) that improves query accuracy over time

vLLM

Local LLM Runners
free
  • PagedAttention memory management for high-throughput multi-request GPU serving
  • Supports 200+ model architectures with an OpenAI-compatible API server
  • Originated at UC Berkeley Sky Computing Lab, now the de facto standard for self-hosted production LLM serving

WhisperX

Speech & Transcription Engines
free
  • 70x real-time transcription speed via batched inference on top of Whisper
  • Adds wav2vec2 forced alignment for accurate word-level timestamps Whisper lacks natively
  • Built-in speaker diarization and VAD preprocessing to cut hallucinations

AssemblyAI

Speech & Transcription Engines
freemium
  • Speech-to-text with audio intelligence
  • Summaries, topics and sentiment
  • Speaker diarization
  • Free tier for developers

CrewAI

Agent Frameworks (Developers)
freemium
  • Role-based multi-agent 'crews'
  • Simple Python API for collaboration
  • Tasks, tools and flows
  • Open-source core

Deepgram

Speech & Transcription Engines
freemium
  • Fast, accurate speech-to-text API
  • Real-time streaming and diarization
  • Voice-agent building blocks
  • Free credits to start

DeepSeek

General Purpose Chatbots
freemium
  • Free access to V3-series & R1 reasoning models
  • Open-weight, MoE-efficient architecture
  • Strong math, coding and reasoning
  • Transparent chain-of-thought mode

Dyad

App Builders & Vibe Coding
freemium
  • Fully open-source, runs locally on your machine with offline capability
  • 21k+ GitHub stars, zero vendor lock-in with clean exportable code
  • Built-in security scanning for SQL injection/XSS in generated apps

ElevenLabs Scribe

Speech & Transcription Engines
freemium
  • Scribe v2 Realtime transcribes in under 150ms latency
  • Dynamic audio-event tagging (laughter, footsteps) beyond plain words
  • Keyterm prompting locks in up to 1,000 specified terms for accuracy

FLUX (Black Forest Labs)

AI Image Generation
freemium
  • Open-weight models you can run locally for free
  • Near-photographic quality in seconds
  • FLUX Kontext for precise editing
  • Powers many third-party apps

GLM (Z.ai)

Notable Open Models
freemium
  • GLM-4.5-Flash and GLM-4.7-Flash text models are free via API
  • Open-weight GLM checkpoints on Hugging Face (MIT-style license for GLM-4.5-Air)
  • Strong agentic/coding benchmark results rivaling DeepSeek and Qwen

LlamaIndex

Agent Frameworks (Developers)
freemium
  • Leading framework for RAG and data agents
  • Connect LLMs to your documents & APIs
  • Agentic document workflows
  • Open-source with a hosted cloud

Mistral OCR 4

AI OCR & Document Extraction
freemium
  • Self-hostable single-container OCR model for regulated industries
  • 170 languages, bounding boxes and per-field confidence scores
  • Low per-thousand-page API pricing; free to try inside Le Chat

Mistral Voxtral

Speech & Transcription Engines
freemium
  • Apache 2.0 open-weight models (24B and 3B) downloadable from Hugging Face
  • Built-in Q&A/summarization over audio, not just raw transcription
  • Function-calling directly from voice input for agent workflows

Msty

Local LLM Runners
freemium
  • Nexus module: unified gateway for managing model connections, credentials and usage policy across providers
  • Governance features (SSO, audit logs, zero telemetry) aimed at private/enterprise use
  • Combines local model chat, agents (Go), and knowledge packages (Stack) in one app

n8n

Workflow Automation
freemium
  • Open-source, self-hostable automation
  • Visual AI-agent and LLM nodes
  • Full code when you need it
  • Free to run yourself

Obsidian

AI Note-Taking & Docs
freemium
  • Local-first markdown knowledge base
  • Rich AI plugin ecosystem
  • Graph view and backlinks
  • Free for personal use

Soniox

Speech & Transcription Engines
freemium
  • Real-time speech-to-text priced well under typical competitor rates
  • Combines transcription + translation in one streaming API call
  • Diarization and speech translation bundled at no extra cost

Speechmatics

Speech & Transcription Engines
freemium
  • Free starting credit with no card required, 56+ language support
  • Model-training discount program cuts costs 33% for data-sharing customers
  • On-premises/VPC deployment for privacy-sensitive enterprise use

Tabnine

Code Autocomplete & Assistants
freemium
  • Privacy-first completions (can run air-gapped)
  • Personalized to your code
  • Model choice and controls
  • Free Basic plan

Lokalise

Translation & Language AI
trial
  • Context-aware AI translation with multi-LLM smart routing across providers
  • Custom AI profiles using RAG tuned to a company's terminology
  • Purpose-built translation-management workflow for software/app localization teams

Claude Cowork

General Autonomous Agents
  • Runs in the Claude desktop app (Mac/Windows)
  • Works with your local files and folders
  • Coordinates sub-agents for parallel work
  • Best for document-heavy autonomous tasks

Related collections

All collections →