Fine-tuning Techniques of LLMs

10.09

Instructor: Yaodong Yang

Topics Covered

• Full-Parameter Fine-Tuning
• Parameter-Efficient Fine-Tuning (PEFT)
• Low-Rank Adaptation (LoRA)
• Quantized Low-Rank Adaptation (QLoRA)