The best free ai models & local execution tools (109)

All 109 ai models & local execution tools in the catalog across 8 sub-categories, ordered free tiers first.

109tools listed
103free or freemium
76with no paid plan at all
8sub-categories covered

Best Free AI Models & Local Execution Tools — straight answers

What are the best free ai models & local execution tools?

Flocci AI Tools lists 109 of them, ordered free tiers first: Arize Phoenix, DeepSeek Models, Design Arena, Epoch AI and ERNIE 4.5 Open Models (Baidu). 103 of the 109 are free or have a free tier. Each entry states what it uniquely does rather than a score.

Which of these are completely free?

76 on this page are marked fully free with no paid plan at all: Arize Phoenix, DeepSeek Models, Design Arena, Epoch AI and ERNIE 4.5 Open Models (Baidu). The remaining 33 are freemium, trial or paid, and each is labelled with its exact tier so nothing surprises you at sign-up.

How is this list ordered?

Free tools first, then freemium, then trial, then paid, and alphabetically inside each tier. Nobody pays to appear higher: Flocci AI Tools carries no ads, no sponsored slots and no paid listings, so the order reflects price and nothing else.

Best Free AI Models & Local Execution Tools — quick picks

Which AI Models & Local Execution Tools work in a browser with no install?

Arize Phoenix, DeepSeek Models, Design Arena, Epoch AI and ERNIE 4.5 Open Models (Baidu) all work in a browser tab with no install needed — just open the site and go. 50 of the 103 free AI Models & Local Execution Tools listed here are browser-based.

Which AI Models & Local Execution Tools let you sign in with Google?

Google Stax, Qwen (Alibaba), Google AI Studio, Langfuse and OpenRouter support Google sign-in, so you can start without creating a new account. That's 5 of the 103 free AI Models & Local Execution Tools on this page.

Which AI Models & Local Execution Tools have a mobile app?

DeepSeek Models, Qwen (Alibaba), sherpa-onnx, AnythingLLM and Google AI Edge Gallery have an iOS or Android app. 11 of the 103 free AI Models & Local Execution Tools here can run on your phone.

Which AI Models & Local Execution Tools can you self-host or run offline?

AnythingLLM, Axolotl, BitNet, DeepEval and EleutherAI LM Evaluation Harness can be self-hosted or run locally without a browser — useful for privacy, air-gapped networks, or avoiding API rate limits. 39 of the 103 free AI Models & Local Execution Tools here run offline.

All 109 tools, free tiers first

Best Free AI Models & Local Execution Tools: pricing tier, category and the capability each tool is listed for.
ToolPricingTypeListed for
Arize PhoenixFreeLLM Eval & ObservabilityFully open-source, self-hostable with zero setup via `uvx` (pip/conda also supported)
DeepSeek ModelsFreeNotable Open ModelsDeepSeek V4-Pro and V4-Flash open-weight MoE models, MIT-licensed
Design ArenaFreeLeaderboards & BenchmarksCrowdsourced Bradley-Terry (Elo-style) ranking of AI models specifically on design/aesthetic quality, not raw capability
Epoch AIFreeLeaderboards & BenchmarksIndependent, non-vendor research institute tracking AI compute, training cost and capability trends over time
ERNIE 4.5 Open Models (Baidu)FreeNotable Open ModelsERNIE-4.5 family including 21B-A3B Thinking and VL-424B-A47B multimodal MoE
Falcon (TII)FreeNotable Open ModelsFalcon-H1 hybrid Transformer-Mamba family for efficient long-context inference
Google StaxFreeLLM Eval & ObservabilityBuild evals with human raters or LLM autoraters on your own data
Hunyuan (Tencent)FreeNotable Open ModelsOpen-weight Hunyuan Hy3 and Hy4-preview flagship text models
LaminarFreeLLM Eval & ObservabilityOpen-source observability and evals platform for AI agents (Apache-2.0)
LiveBenchFreeLeaderboards & BenchmarksContinuously refreshed questions to avoid benchmark contamination
LLaMA-FactoryFreeFine-Tuning & Training FrameworksZero-code Web UI (LLaMA Board) for fine-tuning 100+ open models without writing training scripts
LMArena (Arena.ai)FreeLeaderboards & BenchmarksCrowd-voted 'Battle Mode' blind head-to-head comparisons across text, image, and coding/agent models
MiniMax M2 (open weights)FreeNotable Open ModelsMiniMax's open-weight M-series: M3 multimodal MoE with very long context, plus M2.x agentic-coding checkpoints
Mistral Open Models (Magistral, Devstral, Voxtral)FreeNotable Open ModelsOpen-weight Mistral Medium 3.5, Small 4 and Large 3 general models
NVIDIA Canary-Qwen 2.5BFreeSpeech & Transcription EnginesSpeech-recognition plus LLM hybrid model that transcribes and can summarize or answer questions about audio
NVIDIA CosmosFreeRobotics & Embodied AIOpen platform of world foundation models, datasets and tools for physical AI
NVIDIA ParakeetFreeSpeech & Transcription EnginesTops the Hugging Face Open ASR Leaderboard with 6.05% average WER at 0.6B params
OLMo (Ai2)FreeNotable Open ModelsOnly major model family shipping full pretraining data (Dolma), code and intermediate checkpoints, not just weights
Open ASR Leaderboard (Hugging Face)FreeLeaderboards & BenchmarksRanks speech-recognition models by word error rate and real-time speed across English and multilingual sets
Qwen (Alibaba)FreeNotable Open ModelsOpen Qwen3.x family from phone-sized to multi-trillion-parameter MoE, Apache 2.0
Seed-OSS (ByteDance)FreeNotable Open ModelsSeed-OSS-36B open reasoning LLM with native 512K-token context, Apache 2.0
sherpa-onnxFreeSpeech & Transcription EnginesOffline speech-to-text, text-to-speech, VAD and speaker diarization without internet
Step (StepFun)FreeNotable Open ModelsStep-3.7-Flash open multimodal model with FP8, NVFP4 and GGUF builds
SWE-benchFreeLeaderboards & BenchmarksThe standard benchmark for evaluating autonomous coding agents on real GitHub issue resolution
Xiaomi MiMoFreeNotable Open ModelsMiMo-V2.6-Pro (1T parameters) and V2.6-Flash (311B) open-weight reasoning and agent models
AI Toolkit (Ostris)FreeFine-Tuning & Training FrameworksAll-in-one trainer for LoRAs on diffusion and video models (FLUX, Wan and more)
AnythingLLMFreeLocal LLM RunnersAll-in-one local RAG and agents app
AxolotlFreeFine-Tuning & Training FrameworksConfig-file-driven fine-tuning workflow (YAML) covering LoRA, QLoRA, full fine-tuning, preference tuning and RL
BitNetFreeLocal LLM RunnersOfficial inference framework for 1-bit (ternary) LLMs
DeepEvalFreeLLM Eval & ObservabilityOpen-source LLM evaluation framework with pytest-style tests and 50+ metrics
EleutherAI LM Evaluation HarnessFreeLLM Eval & ObservabilityStandard open framework for running hundreds of benchmarks (MMLU, GSM8K and more) against any LLM
EXAONE (LG AI Research)FreeNotable Open ModelsEXAONE 4.5: LG's first open-weight vision-language model for industrial use cases
exoFreeLocal LLM RunnersLinks everyday devices (Macs, PCs, phones) into one cluster to run models too large for a single machine
faster-whisperFreeSpeech & Transcription EnginesWhisper reimplementation on CTranslate2, up to 4x faster with less memory
FunASRFreeSpeech & Transcription EnginesOpen-source speech recognition toolkit with Paraformer and SenseVoice models
Gemma (Google)FreeNotable Open ModelsGoogle's lightweight open models (Gemma 4)
GenesisFreeRobotics & Embodied AIUnified multi-physics simulation engine plus photorealistic renderer for robotics/embodied-AI training, fully open source
Google AI Edge GalleryFreeLocal LLM RunnersRuns Gemma models fully on-device on Android and iOS, offline after one model download
GPT-OSS (OpenAI)FreeNotable Open ModelsOpenAI's Apache-2.0 open-weight reasoning models (120B and 20B)
GPT4AllFreeLocal LLM RunnersPrivate local chat with your documents
IBM GraniteFreeNotable Open ModelsApache 2.0 licensed enterprise-grade model family
JanFreeLocal LLM RunnersOpen-source, offline ChatGPT alternative
Kimi K3 (Moonshot AI)FreeNotable Open ModelsOpen-weight multimodal MoE with about 2.8T total and 104B active parameters, 1M-token context
KoboldCppFreeLocal LLM RunnersShips as a single portable executable with a bundled web UI (KoboldAI Lite)
LeRobot (Hugging Face)FreeRobotics & Embodied AIOpen PyTorch library for training real-world robot control policies (ACT, Diffusion Policy, VLA models)
LitGPTFreeFine-Tuning & Training FrameworksClean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment
Llama (Meta)FreeNotable Open ModelsMeta's flagship open-weight family (Llama 4)
llama.cppFreeLocal LLM RunnersPure C/C++ inference engine with minimal dependencies, runs on CPU-only hardware
llamafileFreeLocal LLM RunnersPacks model weights and runtime into one executable that runs on macOS, Windows and Linux
LM StudioFreeLocal LLM RunnersPolished desktop GUI for local models
LocalAIFreeLocal LLM RunnersDrop-in OpenAI-compatible API server running models on your own hardware, CPU or GPU
LongCat (Meituan)FreeNotable Open ModelsLongCat-2.0 open-weight 1.8T-parameter model with FP8 and INT8 builds
MediaPipe (Google AI Edge)FreeLocal LLM RunnersCross-platform on-device ML for vision, audio, text and LLM inference
MLC LLMFreeLocal LLM RunnersCompiles and runs LLMs natively on iOS, Android, browsers (WebGPU), Mac, Windows and Linux
MLX-LM (Apple)FreeLocal LLM RunnersPurpose-built for Apple Silicon's unified memory architecture, faster than llama.cpp for many models on Mac
MoonshineFreeSpeech & Transcription EnginesSmall streaming speech-recognition models for phones, browsers and low-power devices
ms-swift (ModelScope)FreeFine-Tuning & Training FrameworksFine-tuning and deployment framework supporting hundreds of LLMs and multimodal models
MuJoCoFreeRobotics & Embodied AIFast, accurate physics engine for robotics and biomechanics research
Nemotron (NVIDIA)FreeNotable Open ModelsNVIDIA's open Nemotron 3 family of efficient agentic models
NVIDIA Isaac GR00TFreeRobotics & Embodied AIOpen, Apache-2.0-licensed vision-language-action foundation model for generalist humanoid robots (GR00T N1.7)
NVIDIA Isaac LabFreeRobotics & Embodied AIGPU-accelerated framework for robot reinforcement and imitation learning on Isaac Sim
OllamaFreeLocal LLM RunnersThe default way to run LLMs locally
Open WebUIFreeLocal LLM RunnersSelf-hosted ChatGPT-style interface
OpenAI WhisperFreeSpeech & Transcription EnginesOpen-source speech-to-text, run locally free
OpenLLMetry (Traceloop)FreeLLM Eval & ObservabilityOpenTelemetry-based instrumentation for LLM calls, vector DBs and frameworks
openpi (Physical Intelligence)FreeRobotics & Embodied AIOpen-source weights and code for pi0, pi0-FAST and pi0.5 vision-language-action models
Phi (Microsoft)FreeNotable Open ModelsMIT-licensed small language models for on-device and edge use
PleiasFreeNotable Open ModelsFully open-weight, open-dataset small language models (350M-3B) explicitly built for EU AI Act compliance
Sarvam Open Models (30B / 105B)FreeNotable Open ModelsSarvam-105B and Sarvam-30B open models built for Indian languages, with FP8 and GGUF builds
SGLangFreeLocal LLM RunnersRadixAttention for automatic prefix-cache reuse across requests
TimesFM (Google Research)FreeNotable Open ModelsPretrained decoder-only foundation model for time-series forecasting
TRL (Hugging Face)FreeFine-Tuning & Training FrameworksPost-training library covering SFT, DPO, GRPO and reward modeling for open LLMs
UnslothFreeFine-Tuning & Training FrameworksFine-tunes LLMs, diffusion, TTS and embedding models 2x faster with ~70% less VRAM than standard Hugging Face training
vLLMFreeLocal LLM RunnersPagedAttention memory management for high-throughput multi-request GPU serving
whisper.cppFreeSpeech & Transcription EnginesC/C++ port of OpenAI Whisper running on CPU, Metal, Core ML, CUDA and Vulkan
WhisperXFreeSpeech & Transcription Engines70x real-time transcription speed via batched inference on top of Whisper
Artificial AnalysisFreemiumLeaderboards & BenchmarksIndependent cross-provider benchmarking of intelligence, speed and price for the same model across different hosting APIs
AssemblyAIFreemiumSpeech & Transcription EnginesSpeech-to-text with audio intelligence
BasetenFreemiumModel Hosting & Inference APIsBasic plan is pay-as-you-go with free starter credits for new accounts
BraintrustFreemiumLLM Eval & ObservabilityFree Starter plan ships model credits and scored evals with no card required
Cloudflare Workers AIFreemiumModel Hosting & Inference APIs10,000 free 'Neurons' of inference per day on every account, resetting daily
Cohere Trial APIFreemiumModel Hosting & Inference APIsEvery account gets a free Trial API key covering chat, embed and rerank models
DeepgramFreemiumSpeech & Transcription EnginesFast, accurate speech-to-text API
ElevenLabs ScribeFreemiumSpeech & Transcription EnginesScribe v2 Realtime transcribes in under 150ms latency
Fireworks AIFreemiumModel Hosting & Inference APIsHigh-performance open-model serving
GLM (Z.ai)FreemiumNotable Open ModelsGLM-5.x flagship and Flash models released as open weights on Hugging Face
Google AI StudioFreemiumModel Hosting & Inference APIsFree-tier API access to Gemini Flash-family models with generous token allowances, no credit card required to start
GroqFreemiumModel Hosting & Inference APIsUltra-fast inference on custom LPUs
Hugging FaceFreemiumModel Hosting & Inference APIsThe hub for open models and datasets
LangfuseFreemiumLLM Eval & ObservabilityFully open-source and self-hostable for free via Docker Compose/Kubernetes, not just a hosted SaaS
LangSmithFreemiumLLM Eval & ObservabilityTracing, evaluation datasets and prompt playground for LLM apps and agents
Mistral VoxtralFreemiumSpeech & Transcription EnginesApache 2.0 open-weight models (24B and 3B) downloadable from Hugging Face
ModelScopeFreemiumModel Hosting & Inference APIsAlibaba's open model hub with thousands of Qwen, Wan and community models
Novita AIFreemiumModel Hosting & Inference APIsSingle API surface for 200+ LLM/image/video/audio models plus on-demand GPU and bare-metal instances
OpenRouterFreemiumModel Hosting & Inference APIsOne API for 400+ models across providers
Opik (Comet)FreemiumLLM Eval & ObservabilityOpen-source LLM tracing, evaluation and prompt-optimization platform (Apache-2.0)
PromptfooFreemiumLLM Eval & ObservabilityOpen-source CLI/library for evaluating prompts, models and RAG pipelines side by side, runs in CI
SonioxFreemiumSpeech & Transcription EnginesReal-time speech-to-text priced well under typical competitor rates
SpeechmaticsFreemiumSpeech & Transcription EnginesFree starting credit with no card required, 56+ language support
W&B WeaveFreemiumLLM Eval & ObservabilityAgent-native tracing model with sessions, steps, tools and sub-agents as first-class concepts (not generic spans)
Z.ai Open Platform (free GLM Flash API)FreemiumModel Hosting & Inference APIsGLM-4.7-Flash and GLM-4.5-Flash text models listed as free for input and output on the public API
MstyFreemiumLocal LLM RunnersNexus module: unified gateway for managing model connections, credentials and usage policy across providers
NVIDIA BuildFreemiumModel Hosting & Inference APIsHosted catalog of 100+ open and NVIDIA models with an OpenAI-compatible endpoint
Cerebras InferenceTrialModel Hosting & Inference APIsRuns open models on Cerebras Wafer-Scale Engine hardware at dramatically higher tokens/sec than GPU-based APIs
ReplicateTrialModel Hosting & Inference APIsRun open models with one API call
DeepInfraModel Hosting & Inference APIsVery low per-token pricing across a large catalog of open models (text, image, audio)
Nebius Token FactoryModel Hosting & Inference APIsEuropean GPU-cloud-backed inference API hosting major open models (Llama, Qwen, DeepSeek, etc.)
SambaNova CloudModel Hosting & Inference APIsHosts open models (DeepSeek, MiniMax, Llama) on SambaNova's own RDU chips for high-speed inference
Together AIModel Hosting & Inference APIsFast, cheap open-model inference

Arize Phoenix

LLM Eval & Observability
free
  • Fully open-source, self-hostable with zero setup via `uvx` (pip/conda also supported)
  • Combines tracing, evals, datasets, experiments and prompt playground in one local-first tool
  • AI engineering agent (PXI) built in for automated troubleshooting of traces

DeepSeek Models

Notable Open Models
free
  • DeepSeek V4-Pro and V4-Flash open-weight MoE models, MIT-licensed
  • Very long context with reasoning and non-reasoning modes
  • Successors to the V3 and R1 lines
  • Free weights plus free web chat

Design Arena

Leaderboards & Benchmarks
free
  • Crowdsourced Bradley-Terry (Elo-style) ranking of AI models specifically on design/aesthetic quality, not raw capability
  • Separate leaderboards for Website, UI Component, Game Dev, Data Viz, 3D, Image, Video and Logo generation
  • Real-time rankings from user votes across 140+ countries rather than a fixed static benchmark

Epoch AI

Leaderboards & Benchmarks
free
  • Independent, non-vendor research institute tracking AI compute, training cost and capability trends over time
  • Maintains FrontierMath and the Epoch Capabilities Index, benchmarks designed to resist saturation/gaming
  • Interactive Data Explorers covering 3,200+ tracked models, data centers, chips and companies, free to browse
freeNew
  • ERNIE-4.5 family including 21B-A3B Thinking and VL-424B-A47B multimodal MoE
  • ERNIE-Image and ERNIE-Image-Turbo 8B text-to-image models
  • Unlimited-OCR 3B document model (1.5M+ downloads)

Falcon (TII)

Notable Open Models
free
  • Falcon-H1 hybrid Transformer-Mamba family for efficient long-context inference
  • Falcon-H1R small reasoning model with strong math results for its size
  • Free commercial use under TII's Falcon license

Google Stax

LLM Eval & Observability
freeNew
  • Build evals with human raters or LLM autoraters on your own data
  • Compare models and prompts on quality, latency and token cost
  • Prebuilt and custom evaluators

Hunyuan (Tencent)

Notable Open Models
free
  • Open-weight Hunyuan Hy3 and Hy4-preview flagship text models
  • Hunyuan3D line for fast image-to-3D generation
  • Hy-MT translation models covering dozens of language pairs

Laminar

LLM Eval & Observability
freeNew
  • Open-source observability and evals platform for AI agents (Apache-2.0)
  • Traces, session replay for browser agents and evaluations
  • Self-hostable

LiveBench

Leaderboards & Benchmarks
freeNew
  • Continuously refreshed questions to avoid benchmark contamination
  • Scores across reasoning, coding, math, data analysis and instruction following
  • Open-source code and free leaderboard

LLaMA-Factory

Fine-Tuning & Training Frameworks
free
  • Zero-code Web UI (LLaMA Board) for fine-tuning 100+ open models without writing training scripts
  • Supports full-tuning, LoRA, 2/3/4/5/6/8-bit QLoRA, DPO, PPO, GaLore and PiSSA in one framework
  • Used internally by Amazon, NVIDIA and Aliyun for open-model post-training

LMArena (Arena.ai)

Leaderboards & Benchmarks
free
  • Crowd-voted 'Battle Mode' blind head-to-head comparisons across text, image, and coding/agent models
  • The most-cited human-preference leaderboard in the industry, referenced in nearly every model launch announcement
  • Rebranded from LMArena to Arena.ai in 2026, now also covering agent and design-to-code leaderboards

MiniMax M2 (open weights)

Notable Open Models
free
  • MiniMax's open-weight M-series: M3 multimodal MoE with very long context, plus M2.x agentic-coding checkpoints
  • Distinct from MiniMax's Hailuo video product
  • Free weights on Hugging Face
  • Open-weight Mistral Medium 3.5, Small 4 and Large 3 general models
  • Devstral for coding agents and Magistral for visible reasoning
  • Voxtral open-weights speech models for transcription and voice agents

NVIDIA Canary-Qwen 2.5B

Speech & Transcription Engines
freeNew
  • Speech-recognition plus LLM hybrid model that transcribes and can summarize or answer questions about audio
  • Topped the Hugging Face Open ASR leaderboard at release (English)
  • CC-BY-4.0 weights

NVIDIA Cosmos

Robotics & Embodied AI
freeNew
  • Open platform of world foundation models, datasets and tools for physical AI
  • Cosmos Predict, Transfer and Reason models on Hugging Face
  • Generates and reasons over synthetic robotics and driving video
  • Open weights under NVIDIA open license

NVIDIA Parakeet

Speech & Transcription Engines
free
  • Tops the Hugging Face Open ASR Leaderboard with 6.05% average WER at 0.6B params
  • CC-BY-4.0 license, free for commercial and non-commercial use
  • RTFx ~3,386 — extremely fast inference relative to accuracy

OLMo (Ai2)

Notable Open Models
free
  • Only major model family shipping full pretraining data (Dolma), code and intermediate checkpoints, not just weights
  • Olmo 3 ships Base, Think, and Instruct variants at 7B/32B
  • OlmoCore training framework and Open Instruct pipeline are also open source

Open ASR Leaderboard (Hugging Face)

Leaderboards & Benchmarks
freeNew
  • Ranks speech-recognition models by word error rate and real-time speed across English and multilingual sets
  • Open, reproducible evaluation code
  • Free to browse

Qwen (Alibaba)

Notable Open Models
free
  • Open Qwen3.x family from phone-sized to multi-trillion-parameter MoE, Apache 2.0
  • Qwen3.6 mid-size models suit agentic coding on one high-memory machine
  • Small Qwen3.5 sizes run on phones and laptops
  • Free weights on Hugging Face and ModelScope

Seed-OSS (ByteDance)

Notable Open Models
freeNew
  • Seed-OSS-36B open reasoning LLM with native 512K-token context, Apache 2.0
  • Base, Base-without-synthetic-data and Instruct checkpoints
  • Adjustable thinking budget for reasoning length

sherpa-onnx

Speech & Transcription Engines
freeNew
  • Offline speech-to-text, text-to-speech, VAD and speaker diarization without internet
  • Runs on Android, iOS, Raspberry Pi, WebAssembly and desktop with many language bindings
  • Apache-2.0

Step (StepFun)

Notable Open Models
freeNew
  • Step-3.7-Flash open multimodal model with FP8, NVFP4 and GGUF builds
  • Step-3.5-Flash text model widely run locally
  • 51 open models incl. audio and image models

SWE-bench

Leaderboards & Benchmarks
free
  • The standard benchmark for evaluating autonomous coding agents on real GitHub issue resolution
  • Multiple official variants (Verified, Multimodal, Multilingual, Lite) for different evaluation needs
  • Companion tooling (SWE-agent, mini-SWE-agent) for running the benchmark yourself, fully open

Xiaomi MiMo

Notable Open Models
freeNew
  • MiMo-V2.6-Pro (1T parameters) and V2.6-Flash (311B) open-weight reasoning and agent models
  • Distilled MiMo-V2.6-Distill-Qwen-9B for single-GPU use
  • V2-Flash, V2.5 and V2.5-Pro checkpoints also published

AI Toolkit (Ostris)

Fine-Tuning & Training Frameworks
freeNew
  • All-in-one trainer for LoRAs on diffusion and video models (FLUX, Wan and more)
  • Web UI and config-file workflows, runs on consumer GPUs
  • MIT licensed

AnythingLLM

Local LLM Runners
free
  • All-in-one local RAG and agents app
  • Chat with your docs privately
  • Works with local or cloud models
  • Free and open-source

Axolotl

Fine-Tuning & Training Frameworks
free
  • Config-file-driven fine-tuning workflow (YAML) covering LoRA, QLoRA, full fine-tuning, preference tuning and RL
  • Broad multi-model and multimodal training support with GPU-efficiency optimizations built in
  • Popular choice for reproducible post-training recipes shared across the open-model community

BitNet

Local LLM Runners
freeNew
  • Official inference framework for 1-bit (ternary) LLMs
  • Fast lossless CPU inference with low energy use
  • Runs large models on laptops without a GPU
  • MIT-licensed open source

DeepEval

LLM Eval & Observability
freeNew
  • Open-source LLM evaluation framework with pytest-style tests and 50+ metrics
  • RAG, agent and conversational metrics; red-teaming module
  • Apache-2.0; optional Confident AI cloud has a free tier

EleutherAI LM Evaluation Harness

LLM Eval & Observability
freeNew
  • Standard open framework for running hundreds of benchmarks (MMLU, GSM8K and more) against any LLM
  • Backs the Hugging Face Open LLM evaluations
  • MIT licensed CLI and Python library

EXAONE (LG AI Research)

Notable Open Models
free
  • EXAONE 4.5: LG's first open-weight vision-language model for industrial use cases
  • 33B flagship plus FP8/AWQ quantized variants for efficient local deployment
  • Backed by LG's enterprise/manufacturing domain tuning

exo

Local LLM Runners
freeNew
  • Links everyday devices (Macs, PCs, phones) into one cluster to run models too large for a single machine
  • Automatic device discovery and model partitioning
  • Apache-2.0 open source

faster-whisper

Speech & Transcription Engines
freeNew
  • Whisper reimplementation on CTranslate2, up to 4x faster with less memory
  • int8 quantization for GPU and CPU
  • MIT licensed Python library

FunASR

Speech & Transcription Engines
freeNew
  • Open-source speech recognition toolkit with Paraformer and SenseVoice models
  • Streaming ASR, VAD, punctuation and speaker diarization
  • Strong Mandarin and multilingual accuracy
  • Runs on CPU or GPU, MIT-style license

Gemma (Google)

Notable Open Models
free
  • Google's lightweight open models (Gemma 4)
  • Runs in as little as 16GB RAM
  • On-device and multimodal variants
  • Free and open

Genesis

Robotics & Embodied AI
free
  • Unified multi-physics simulation engine plus photorealistic renderer for robotics/embodied-AI training, fully open source
  • 30,000+ GitHub stars, actively updated as recently as Aug 2026
  • Pythonic API designed to be dramatically faster than prior simulators for RL/robot-policy training

Google AI Edge Gallery

Local LLM Runners
freeNew
  • Runs Gemma models fully on-device on Android and iOS, offline after one model download
  • Chat, image questions, audio transcription and prompt lab
  • No account or Google login required
  • Open-source app from the Google AI Edge team

GPT-OSS (OpenAI)

Notable Open Models
free
  • OpenAI's Apache-2.0 open-weight reasoning models (120B and 20B)
  • Run locally or self-host, with configurable reasoning effort
  • Safeguard variants for policy-based content classification

GPT4All

Local LLM Runners
free
  • Private local chat with your documents
  • Runs on modest laptops
  • LocalDocs RAG built in
  • Free and open-source

IBM Granite

Notable Open Models
free
  • Apache 2.0 licensed enterprise-grade model family
  • Hybrid Mamba/transformer architecture (Granite 4) for lower memory footprint
  • Built-in focus on governance, provenance and enterprise compliance

Jan

Local LLM Runners
free
  • Open-source, offline ChatGPT alternative
  • No-config, privacy-first GUI
  • Runs fully on your device
  • Free forever

Kimi K3 (Moonshot AI)

Notable Open Models
freeNew
  • Open-weight multimodal MoE with about 2.8T total and 104B active parameters, 1M-token context
  • Native text, image and video input with configurable thinking effort
  • Earlier open Kimi K2.x (K2.5, K2.6, K2.7-Code) remain downloadable from the same org
  • Weights free to download; also usable free in kimi.com chat with limits

KoboldCpp

Local LLM Runners
free
  • Ships as a single portable executable with a bundled web UI (KoboldAI Lite)
  • Generates text, image, video and speech from one local app
  • Runs on CPU or GPU with no installation required

LeRobot (Hugging Face)

Robotics & Embodied AI
free
  • Open PyTorch library for training real-world robot control policies (ACT, Diffusion Policy, VLA models)
  • Direct integration with Hugging Face Hub for sharing datasets and pretrained robot policies
  • Works with low-cost hobbyist robot arms (SO-100/101), not just simulation

LitGPT

Fine-Tuning & Training Frameworks
freeNew
  • Clean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment
  • YAML recipes with LoRA, QLoRA and FSDP
  • Apache-2.0

Llama (Meta)

Notable Open Models
free
  • Meta's flagship open-weight family (Llama 4)
  • Multimodal and long-context variants
  • Run locally or via any host
  • Free, permissive license

llama.cpp

Local LLM Runners
free
  • Pure C/C++ inference engine with minimal dependencies, runs on CPU-only hardware
  • Powers the GGUF format used by Ollama, LM Studio and most local runners under the hood
  • Broad quantization support (2-bit to 8-bit) for running large models on consumer hardware

llamafile

Local LLM Runners
freeNew
  • Packs model weights and runtime into one executable that runs on macOS, Windows and Linux
  • Built on llama.cpp with a bundled local web UI and OpenAI-compatible server
  • Mozilla-backed, no install or account needed

LM Studio

Local LLM Runners
free
  • Polished desktop GUI for local models
  • Discover, download and chat with GGUF models
  • Local server with OpenAI-compatible API
  • Free for personal use

LocalAI

Local LLM Runners
freeNew
  • Drop-in OpenAI-compatible API server running models on your own hardware, CPU or GPU
  • Covers text, image, audio and embeddings in one server
  • MIT licensed with multi-user support

LongCat (Meituan)

Notable Open Models
freeNew
  • LongCat-2.0 open-weight 1.8T-parameter model with FP8 and INT8 builds
  • LongCat-Flash-Lite-Sparse 69B, LongCat-Flash-Prover and LongCat-Next any-to-any models
  • Also AudioDiT speech and Video-Avatar models, all downloadable
freeNew
  • Cross-platform on-device ML for vision, audio, text and LLM inference
  • Ready-made pose, face, hand and object tasks
  • Runs in browser, Android, iOS and desktop
  • Free and open source

MLC LLM

Local LLM Runners
freeNew
  • Compiles and runs LLMs natively on iOS, Android, browsers (WebGPU), Mac, Windows and Linux
  • OpenAI-compatible server engine
  • Apache-2.0

MLX-LM (Apple)

Local LLM Runners
free
  • Purpose-built for Apple Silicon's unified memory architecture, faster than llama.cpp for many models on Mac
  • Built-in LoRA/QLoRA fine-tuning support, not just inference
  • Direct Hugging Face Hub integration for pulling and pushing quantized models

Moonshine

Speech & Transcription Engines
freeNew
  • Small streaming speech-recognition models for phones, browsers and low-power devices
  • Low latency for live voice interfaces
  • Free open-source weights and runtime

ms-swift (ModelScope)

Fine-Tuning & Training Frameworks
freeNew
  • Fine-tuning and deployment framework supporting hundreds of LLMs and multimodal models
  • LoRA, full-parameter, DPO, GRPO and quantization in one toolkit
  • Apache-2.0, maintained by Alibaba's ModelScope community

MuJoCo

Robotics & Embodied AI
freeNew
  • Fast, accurate physics engine for robotics and biomechanics research
  • Python bindings, MJX on GPU/TPU via JAX
  • Apache-2.0

Nemotron (NVIDIA)

Notable Open Models
free
  • NVIDIA's open Nemotron 3 family of efficient agentic models
  • Top-ranked open embedding models (Llama-Embed-Nemotron)
  • Open training datasets released alongside the models

NVIDIA Isaac GR00T

Robotics & Embodied AI
free
  • Open, Apache-2.0-licensed vision-language-action foundation model for generalist humanoid robots (GR00T N1.7)
  • Opened to all developers worldwide Apr 2026 (previously partner-only), running on DGX Cloud
  • Full pipeline: pretrained model + simulation fine-tuning + deployment tools, not just a research checkpoint

NVIDIA Isaac Lab

Robotics & Embodied AI
freeNew
  • GPU-accelerated framework for robot reinforcement and imitation learning on Isaac Sim
  • Ready environments for humanoids, manipulators and legged robots
  • BSD-3-Clause open source

Ollama

Local LLM Runners
free
  • The default way to run LLMs locally
  • One command to run Llama, Qwen, DeepSeek…
  • OpenAI-compatible local API
  • Free and open-source

Open WebUI

Local LLM Runners
free
  • Self-hosted ChatGPT-style interface
  • Works with Ollama and OpenAI-compatible APIs
  • RAG, tools and multi-user
  • Free and open-source

OpenAI Whisper

Speech & Transcription Engines
free
  • Open-source speech-to-text, run locally free
  • 99+ languages and translation
  • Robust to accents and noise
  • Powers countless apps

OpenLLMetry (Traceloop)

LLM Eval & Observability
freeNew
  • OpenTelemetry-based instrumentation for LLM calls, vector DBs and frameworks
  • Ships traces to Datadog, Grafana, Honeycomb or any OTel backend
  • Apache-2.0

openpi (Physical Intelligence)

Robotics & Embodied AI
freeNew
  • Open-source weights and code for pi0, pi0-FAST and pi0.5 vision-language-action models
  • Fine-tuning recipes for new robots and tasks
  • Apache-2.0

Phi (Microsoft)

Notable Open Models
free
  • MIT-licensed small language models for on-device and edge use
  • Phi-4 reasoning and reasoning-vision variants decide when to think step by step
  • Phi-4-mini and multimodal variants handle text, vision and audio
  • Available on Hugging Face, Azure AI Foundry and Ollama

Pleias

Notable Open Models
free
  • Fully open-weight, open-dataset small language models (350M-3B) explicitly built for EU AI Act compliance
  • Trained exclusively on the 2-trillion-token open Common Corpus, not scraped/licensed text
  • Purpose-built RAG models (Pleias-RAG-350M/1B) with built-in citation tracking, Apache 2.0 licensed
freeNew
  • Sarvam-105B and Sarvam-30B open models built for Indian languages, with FP8 and GGUF builds
  • Sarvam-Translate 4B for multilingual translation
  • Downloadable from Hugging Face at no cost

SGLang

Local LLM Runners
free
  • RadixAttention for automatic prefix-cache reuse across requests
  • Day-0 support for newly released open models (e.g. Kimi K3) among the fastest of any runner
  • Scales from single GPU to distributed multi-node clusters with speculative decoding

TimesFM (Google Research)

Notable Open Models
freeNew
  • Pretrained decoder-only foundation model for time-series forecasting
  • Zero-shot forecasts with quantile outputs
  • Weights on Hugging Face, also in BigQuery
  • Apache-2.0 licensed

TRL (Hugging Face)

Fine-Tuning & Training Frameworks
freeNew
  • Post-training library covering SFT, DPO, GRPO and reward modeling for open LLMs
  • Integrates with Transformers, PEFT and vLLM
  • Apache-2.0

Unsloth

Fine-Tuning & Training Frameworks
free
  • Fine-tunes LLMs, diffusion, TTS and embedding models 2x faster with ~70% less VRAM than standard Hugging Face training
  • Free Google Colab notebooks let anyone fine-tune open models like Llama/Qwen/GLM on a free T4 GPU
  • Supports LoRA, QLoRA, full fine-tuning, GRPO and DPO reinforcement/preference tuning in one library

vLLM

Local LLM Runners
free
  • PagedAttention memory management for high-throughput multi-request GPU serving
  • Supports 200+ model architectures with an OpenAI-compatible API server
  • Originated at UC Berkeley Sky Computing Lab, now the de facto standard for self-hosted production LLM serving

whisper.cpp

Speech & Transcription Engines
freeNew
  • C/C++ port of OpenAI Whisper running on CPU, Metal, Core ML, CUDA and Vulkan
  • Runs on phones, Raspberry Pi and browsers via WASM
  • MIT licensed

WhisperX

Speech & Transcription Engines
free
  • 70x real-time transcription speed via batched inference on top of Whisper
  • Adds wav2vec2 forced alignment for accurate word-level timestamps Whisper lacks natively
  • Built-in speaker diarization and VAD preprocessing to cut hallucinations

Artificial Analysis

Leaderboards & Benchmarks
freemium
  • Independent cross-provider benchmarking of intelligence, speed and price for the same model across different hosting APIs
  • Artificial Analysis Intelligence Index aggregates multiple benchmarks into one comparable score
  • Covers coding agents, image/video, speech and vertical (finance/legal/health) evaluations, not just chat

AssemblyAI

Speech & Transcription Engines
freemium
  • Speech-to-text with audio intelligence
  • Summaries, topics and sentiment
  • Speaker diarization
  • Free tier for developers

Baseten

Model Hosting & Inference APIs
freemium
  • Basic plan is pay-as-you-go with free starter credits for new accounts
  • Deploys custom/fine-tuned models, not just a fixed model catalog, with per-second GPU billing
  • Hosts current open models (DeepSeek, GPT-OSS, Kimi K3) as ready-to-call APIs alongside custom deployment

Braintrust

LLM Eval & Observability
freemium
  • Free Starter plan ships model credits and scored evals with no card required
  • Unlimited users/projects/datasets/playgrounds even on the free tier
  • Built-in playground for side-by-side prompt/model comparison against production traces

Cloudflare Workers AI

Model Hosting & Inference APIs
freemium
  • 10,000 free 'Neurons' of inference per day on every account, resetting daily
  • Runs open models (Llama, Mistral, Whisper, etc.) on Cloudflare's global edge network for low-latency serverless inference
  • Bundled with Workers/Pages for building full serverless AI apps without managing GPUs

Cohere Trial API

Model Hosting & Inference APIs
freemiumNew
  • Every account gets a free Trial API key covering chat, embed and rerank models
  • Rate-limited, non-commercial use only
  • Upgrade to a pay-as-you-go production key when needed

Deepgram

Speech & Transcription Engines
freemium
  • Fast, accurate speech-to-text API
  • Real-time streaming and diarization
  • Voice-agent building blocks
  • Free credits to start

ElevenLabs Scribe

Speech & Transcription Engines
freemium
  • Scribe v2 Realtime transcribes in under 150ms latency
  • Dynamic audio-event tagging (laughter, footsteps) beyond plain words
  • Keyterm prompting locks in up to 1,000 specified terms for accuracy

Fireworks AI

Model Hosting & Inference APIs
freemium
  • High-performance open-model serving
  • Fine-tuning and function calling
  • Vision and audio models
  • Free trial credits

GLM (Z.ai)

Notable Open Models
freemium
  • GLM-5.x flagship and Flash models released as open weights on Hugging Face
  • GLM-4.x Flash text and vision models are free via the Z.ai API
  • Strong agentic and coding results among open Chinese models

Google AI Studio

Model Hosting & Inference APIs
freemium
  • Free-tier API access to Gemini Flash-family models with generous token allowances, no credit card required to start
  • Browser-based playground for prompt design, multimodal testing, and one-click API key generation
  • Batch API offers 50% cost reduction once on the paid tier

Groq

Model Hosting & Inference APIs
freemium
  • Ultra-fast inference on custom LPUs
  • Sub-second responses for open models
  • OpenAI-compatible API
  • Generous free tier

Hugging Face

Model Hosting & Inference APIs
freemium
  • The hub for open models and datasets
  • Spaces to host and demo apps
  • Inference endpoints and providers
  • Free accounts and hosting

Langfuse

LLM Eval & Observability
freemium
  • Fully open-source and self-hostable for free via Docker Compose/Kubernetes, not just a hosted SaaS
  • Hobby cloud plan is free with no credit card, 50k observability units/month
  • Combines tracing, prompt management, evals and datasets in one open platform

LangSmith

LLM Eval & Observability
freemiumNew
  • Tracing, evaluation datasets and prompt playground for LLM apps and agents
  • Developer plan is free with 5k base traces a month and one seat
  • Framework-agnostic, works beyond LangChain

Mistral Voxtral

Speech & Transcription Engines
freemium
  • Apache 2.0 open-weight models (24B and 3B) downloadable from Hugging Face
  • Built-in Q&A/summarization over audio, not just raw transcription
  • Function-calling directly from voice input for agent workflows

ModelScope

Model Hosting & Inference APIs
freemiumNew
  • Alibaba's open model hub with thousands of Qwen, Wan and community models
  • Free inference quota (community reports about 2,000 requests a day, OpenAI-compatible)
  • Free demo spaces (Studios) and notebooks
  • International site at modelscope.ai

Novita AI

Model Hosting & Inference APIs
freemium
  • Single API surface for 200+ LLM/image/video/audio models plus on-demand GPU and bare-metal instances
  • Agent Sandbox for secure agent runtimes alongside model hosting
  • 'Free to start' onboarding credits across model and GPU products

OpenRouter

Model Hosting & Inference APIs
freemium
  • One API for 400+ models across providers
  • Automatic fallbacks and price routing
  • Some models free to use
  • Unified billing

Opik (Comet)

LLM Eval & Observability
freemiumNew
  • Open-source LLM tracing, evaluation and prompt-optimization platform (Apache-2.0)
  • Free cloud plan with 25k spans a month, up to 10 team members and 60-day retention
  • Self-host with no limits

Promptfoo

LLM Eval & Observability
freemium
  • Open-source CLI/library for evaluating prompts, models and RAG pipelines side by side, runs in CI
  • Automated red-teaming to surface prompt injection, jailbreak and data-leak vulnerabilities
  • 300,000+ user community with an enterprise tier for teams needing hosted guardrails

Soniox

Speech & Transcription Engines
freemium
  • Real-time speech-to-text priced well under typical competitor rates
  • Combines transcription + translation in one streaming API call
  • Diarization and speech translation bundled at no extra cost

Speechmatics

Speech & Transcription Engines
freemium
  • Free starting credit with no card required, 56+ language support
  • Model-training discount program cuts costs 33% for data-sharing customers
  • On-premises/VPC deployment for privacy-sensitive enterprise use

W&B Weave

LLM Eval & Observability
freemium
  • Agent-native tracing model with sessions, steps, tools and sub-agents as first-class concepts (not generic spans)
  • Pre-built safety/quality scorers for toxicity, bias, PII and hallucination detection out of the box
  • Built on Weights & Biases' existing ML-experiment infrastructure, useful for teams already on W&B

Z.ai Open Platform (free GLM Flash API)

Model Hosting & Inference APIs
freemiumNew
  • GLM-4.7-Flash and GLM-4.5-Flash text models listed as free for input and output on the public API
  • GLM-4.6V-Flash vision model also free
  • Larger GLM-5.x models are paid

Msty

Local LLM Runners
freemium
  • Nexus module: unified gateway for managing model connections, credentials and usage policy across providers
  • Governance features (SSO, audit logs, zero telemetry) aimed at private/enterprise use
  • Combines local model chat, agents (Go), and knowledge packages (Stack) in one app

NVIDIA Build

Model Hosting & Inference APIs
freemiumNew
  • Hosted catalog of 100+ open and NVIDIA models with an OpenAI-compatible endpoint
  • Free API key via the NVIDIA Developer Program with no credit card
  • Try models in-browser playground before self-hosting NIM
  • Rate-limited (community reports about 40 requests per minute)

Cerebras Inference

Model Hosting & Inference APIs
trial
  • Runs open models on Cerebras Wafer-Scale Engine hardware at dramatically higher tokens/sec than GPU-based APIs
  • Trial credits expire after 30 days and need a verified payment method.
  • Popular backend choice for latency-sensitive agentic and coding tools

Replicate

Model Hosting & Inference APIs
trial
  • Run open models with one API call
  • Thousands of community models
  • Deploy your own with Cog
  • Only a few models run free; everything else needs billing set up.

DeepInfra

Model Hosting & Inference APIs
  • Very low per-token pricing across a large catalog of open models (text, image, audio)
  • Flex scheduling tier at 0.8x price for non-production/batch workloads
  • No subscription; usage-tier system auto-scales billing thresholds

Nebius Token Factory

Model Hosting & Inference APIs
  • European GPU-cloud-backed inference API hosting major open models (Llama, Qwen, DeepSeek, etc.)
  • Rebranded in 2026 from 'Nebius AI Studio' to 'Nebius Token Factory'
  • Backed by Nebius's own large-scale GPU cloud infrastructure rather than reselling capacity

SambaNova Cloud

Model Hosting & Inference APIs
  • Hosts open models (DeepSeek, MiniMax, Llama) on SambaNova's own RDU chips for high-speed inference
  • Per-token pricing with no platform subscription required
  • Competes directly with Cerebras/Groq on raw tokens/sec for open-weight models

Together AI

Model Hosting & Inference APIs
  • Fast, cheap open-model inference
  • 200+ models via one API
  • Fine-tuning and dedicated endpoints
  • Docs state no free trials and a minimum credit purchase is needed to use the platform.

Related collections

All collections →