arXiv cs.CLPaperClaude Watch
Unintended Side Effects of Value Training in LLMs
Real and unsettling: value alignment isn't orthogonal, it's coupled. Training for one value shifts others in unpredictable ways. For teams doing RLHF or fine-tuning for safety or cultural fit, this says you need broader behavioral evaluation before shipping. Single-axis optimization on values can break things you didn't intend to touch.