Preference optimization gains a linguistic constraint: folding information uniformity into the reward brings model wording closer to human habits
A preference optimization reward built on the psycholinguistic uniform information density hypothesis matches SimPO on AlpacaEval 2, Arena-Hard and MT-Bench, and moves English complement-clause that usage closer to natural language.