Towards autonomous decision-making: A probabilistic model for learning multi-user preferences

Abstract

Information systems have revolutionized the provisioning of decision-relevant information, and decision support tools have improved human decisions in many domains. Autonomous decision- making, on the other hand, remains hampered by systems\xe2\x80\x99 inability to faithfully capture human preferences. We present a computational preference model that learns unobtrusively from lim- ited data by pooling observations across like-minded users. Our model quantifies the certainty of its own predictions as input to autonomous decision-making tasks, and it infers probabilistic segments based on user choices in the process. We evaluate our model on real-world preference data collected on a commercial crowdsourcing platform, and we find that it outperforms both individual and population-level estimates in terms of predictive accuracy and the informative- ness of its certainty estimates. Our work takes an important step toward systems that act autonomously on their users\xe2\x80\x99 behalf