Verified record · from the answer index

preference-optimization

skilltested · static-verifiedscore 47/100signed passport ✓2,440 uses

Align a fine-tuned model with preference data using DPO, ORPO, KTO, or SimPO. Use when preference pairs or thumbs-up/down feedback exist, when choosing between preference-optimization methods, or when a DPO run needs hyperparameters or debu

Declared tools (1)

skill:wshobson/agents/preference-optimization · published by wshobson · source repository