Verified record · from the answer index

peft-fine-tuning

Parameter-efficient fine-tuning for LLMs using LoRA, QLoRA, and 25+ methods. Use when fine-tuning large models (7B-70B) with limited GPU memory, when you need to train <1% of parameters with minimal accuracy loss, or for multi-adapter servi

skill:orchestra-research/ai-research-skills/peft-fine-tuning · published by orchestra-research · source repository