Our paper Preference Poisoning Attacks on Reward Model Learning is accepted by IEEE S&P 2025!