DPO
Definition
Direct Preference Optimization. An mathematical alternative to RLHF that optimizes policy networks directly using human preference datasets.
Example Case
Tuning Zephyr-7B using preference pairs without training a separate reward model.