Skip to content
#

ddp

Here are 47 public repositories matching this topic...

Llama-style transformer in PyTorch with multi-node / multi-GPU training. Includes pretraining, fine-tuning, DPO, LoRA, and knowledge distillation. Scripts for dataset mixing and training from scratch.

  • Updated Feb 24, 2026
  • Python

Improve this page

Add a description, image, and links to the ddp topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the ddp topic, visit your repo's landing page and select "manage topics."

Learn more