Fine-Tuning & Training FrameworksfreeNew

LitGPT

Clean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment

Visit LitGPT

What LitGPT does

  • Clean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment
  • YAML recipes with LoRA, QLoRA and FSDP
  • Apache-2.0

LitGPT — straight answers

What is LitGPT?

LitGPT is listed under Fine-Tuning & Training Frameworks, in the AI Models & Local Execution category on Flocci AI Tools. Clean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment. It is free, with no paid plan attached, and it lives at github.com.

Is LitGPT free?

LitGPT is listed as fully free — there is no paid tier attached to it in the catalog. That makes it one of the 399 entries on Flocci AI Tools with no upgrade path built in.

What can LitGPT do?

LitGPT does 3 things the catalog singles out: Clean from-scratch implementations of 20+ llms for pretraining, fine-tuning and deployment; yaml recipes with lora, qlora and fsdp; apache-2.0.

What is the best free alternative to LitGPT?

AI Toolkit (Ostris) is the closest free alternative: it sits in the same Fine-Tuning & Training Frameworks sub-category and is free. Axolotl, LLaMA-Factory and ms-swift (ModelScope) also start free. The full list is on the alternatives page.

See the full list →

LitGPT alternatives

Compare all alternatives →

Unsloth

Fine-Tuning & Training Frameworks
free
  • Fine-tunes LLMs, diffusion, TTS and embedding models 2x faster with ~70% less VRAM than standard Hugging Face training
  • Free Google Colab notebooks let anyone fine-tune open models like Llama/Qwen/GLM on a free T4 GPU
  • Supports LoRA, QLoRA, full fine-tuning, GRPO and DPO reinforcement/preference tuning in one library
Visit

Axolotl

Fine-Tuning & Training Frameworks
free
  • Config-file-driven fine-tuning workflow (YAML) covering LoRA, QLoRA, full fine-tuning, preference tuning and RL
  • Broad multi-model and multimodal training support with GPU-efficiency optimizations built in
  • Popular choice for reproducible post-training recipes shared across the open-model community
Visit

LLaMA-Factory

Fine-Tuning & Training Frameworks
free
  • Zero-code Web UI (LLaMA Board) for fine-tuning 100+ open models without writing training scripts
  • Supports full-tuning, LoRA, 2/3/4/5/6/8-bit QLoRA, DPO, PPO, GaLore and PiSSA in one framework
  • Used internally by Amazon, NVIDIA and Aliyun for open-model post-training
Visit

TRL (Hugging Face)

Fine-Tuning & Training Frameworks
freeNew
  • Post-training library covering SFT, DPO, GRPO and reward modeling for open LLMs
  • Integrates with Transformers, PEFT and vLLM
  • Apache-2.0
Visit

ms-swift (ModelScope)

Fine-Tuning & Training Frameworks
freeNew
  • Fine-tuning and deployment framework supporting hundreds of LLMs and multimodal models
  • LoRA, full-parameter, DPO, GRPO and quantization in one toolkit
  • Apache-2.0, maintained by Alibaba's ModelScope community
Visit

AI Toolkit (Ostris)

Fine-Tuning & Training Frameworks
freeNew
  • All-in-one trainer for LoRAs on diffusion and video models (FLUX, Wan and more)
  • Web UI and config-file workflows, runs on consumer GPUs
  • MIT licensed
Visit

Head-to-head comparisons

LitGPT vs UnslothLitGPT vs AxolotlLitGPT vs LLaMA-FactoryLitGPT vs TRL (Hugging Face)LitGPT vs ms-swift (ModelScope)LitGPT vs AI Toolkit (Ostris)