Fine-Tuning & Training Frameworksfree

LitGPT

Clean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment

Visit LitGPT

What LitGPT does

  • Clean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment
  • YAML recipes with LoRA, QLoRA and FSDP
  • Apache-2.0

LitGPT — straight answers

What is LitGPT?

LitGPT is listed under Fine-Tuning & Training Frameworks, in the AI Models & Local Execution category on Flocci AI Tools. Clean from-scratch implementations of 20+ LLMs for pretraining, fine-tuning and deployment. It is free, with no paid plan attached, and it lives at github.com.

Is LitGPT free?

LitGPT is listed as fully free — there is no paid tier attached to it in the catalog. That makes it one of the 397 entries on Flocci AI Tools with no upgrade path built in.

Can I use LitGPT in a browser, or is there an app?

LitGPT needs to be installed or self-hosted — it doesn't run in a browser tab. It is available on the command line and self-hosting.

What can LitGPT do?

LitGPT does 3 things the catalog singles out: Clean from-scratch implementations of 20+ llms for pretraining, fine-tuning and deployment; yaml recipes with lora, qlora and fsdp; apache-2.0.

What is the best free alternative to LitGPT?

LLaMA-Factory is the closest free alternative: it sits in the same Fine-Tuning & Training Frameworks sub-category and is free. AI Toolkit (Ostris), Axolotl and ms-swift (ModelScope) also start free. The full list is on the alternatives page.

See the full list →

LitGPT alternatives

Compare all alternatives →

Unsloth

Fine-Tuning & Training Frameworks
free
  • Fine-tunes LLMs, diffusion, TTS and embedding models 2x faster with ~70% less VRAM than standard Hugging Face training
  • Free Google Colab notebooks let anyone fine-tune open models like Llama/Qwen/GLM on a free T4 GPU
  • Supports LoRA, QLoRA, full fine-tuning, GRPO and DPO reinforcement/preference tuning in one library
Visit

Axolotl

Fine-Tuning & Training Frameworks
free
  • Config-file-driven fine-tuning workflow (YAML) covering LoRA, QLoRA, full fine-tuning, preference tuning and RL
  • Broad multi-model and multimodal training support with GPU-efficiency optimizations built in
  • Popular choice for reproducible post-training recipes shared across the open-model community
Visit

LLaMA-Factory

Fine-Tuning & Training Frameworks
free
  • Zero-code Web UI (LLaMA Board) for fine-tuning 100+ open models without writing training scripts
  • Supports full-tuning, LoRA, 2/3/4/5/6/8-bit QLoRA, DPO, PPO, GaLore and PiSSA in one framework
  • Used internally by Amazon, NVIDIA and Aliyun for open-model post-training
Visit

TRL (Hugging Face)

Fine-Tuning & Training Frameworks
free
  • Post-training library covering SFT, DPO, GRPO and reward modeling for open LLMs
  • Integrates with Transformers, PEFT and vLLM
  • Apache-2.0
Visit

ms-swift (ModelScope)

Fine-Tuning & Training Frameworks
free
  • Fine-tuning and deployment framework supporting hundreds of LLMs and multimodal models
  • LoRA, full-parameter, DPO, GRPO and quantization in one toolkit
  • Apache-2.0, maintained by Alibaba's ModelScope community
Visit

AI Toolkit (Ostris)

Fine-Tuning & Training Frameworks
free
  • All-in-one trainer for LoRAs on diffusion and video models (FLUX, Wan and more)
  • Web UI and config-file workflows, runs on consumer GPUs
  • MIT licensed
Visit

Head-to-head comparisons

LitGPT vs UnslothLitGPT vs AxolotlLitGPT vs LLaMA-FactoryLitGPT vs TRL (Hugging Face)LitGPT vs ms-swift (ModelScope)LitGPT vs AI Toolkit (Ostris)