arXiv cs.AIPaper
Participatory Moral AI Is Not Neutral: The Invisible Hand of Developers
Moral AI elicitation looks neutral but isn't. The real story is that three opaque developer decisions upstream of any vote produce measurable preference shifts across kidney allocation, worker simulation, and synthetic media contexts. For builders using preference data to align models: document these choices and test sensitivity to them, because your users will eventually ask why you framed the question that way. For founders building moral AI products: this is your disclosure and governance problem.