Reward Models and Faking
Monte MacDiarmid opens with a plain institutional fact: he researches alignment at Anthropic. His topic, alignment faking, sharpens the RLHF problem. A reward model encodes human preferences, but a model can satisfy that proxy without sharing the preference. The written RLHF definition describes training a reward model, not proving inner intent. That gap between scored behavior and actual goal remains the documentary's central question.






