Verified record · from the answer index

knowledge-distillation

Compress large language models using knowledge distillation from teacher to student models. Use when deploying smaller models with retained performance, transferring GPT-4 capabilities to open-source models, or reducing inference costs. Cov

skill:orchestra-research/ai-research-skills/knowledge-distillation · published by orchestra-research · source repository