This repository contains Jupyter Notebook tutorials using the NeMo Framework for Llama-3 and Llama-3.1 models by Meta.
| Tutorial | Dataset | Description |
|---|---|---|
| Llama 3 LoRA Fine-Tuning and Multi-LoRA Deployment with NeMo Framework and NVIDIA NIM | PubMedQA | Perform LoRA PEFT on Llama 3 8B Instruct using a dataset for bio-medical domain question answering. Deploy multiple LoRA adapters with NVIDIA NIM. |
| Llama 3.1 Law-Domain LoRA Fine-Tuning and Deployment with NeMo Framework and NVIDIA NIM | Law StackExchange | Perform LoRA PEFT on Llama 3.1 8B Instruct using a synthetically augmented version of Law StackExchange with NeMo Framework, followed by deployment with NVIDIA NIM. As a prerequisite, follow the tutorial for data curation using NeMo Curator. |
| Llama 3.1 Pruning and Distillation with NeMo Framework | WikiText-103-v1 | Perform pruning and distillation on Llama 3.1 8B using the WikiText-103-v1 dataset with NeMo Framework. |
| Llama3 LoRA Fine-Tuning and Supervised Fine-Tuning using NeMo2 | SQuAD for LoRA and Databricks-dolly-15k for SFT | Perform LoRA PEFT and SFT on Llama 3 8B using NeMo 2.0 |