1 articles about preference optimization
Research shows Direct Preference Optimization can fix text degeneration in OCR models, cutting repetition-loop failures by an average 59.4 percent across five model families after fine-tuning.