Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Model
Workshop Talk - Italian Information Retrieval Workshop (IIR 2019). September 16-18, 2019. Padova, Italy.
Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Models
Information retrieval effectiveness evaluation is often carried out by means of test collections. Many works investigated possible sources of bias in such an approach. We propose a systematic approach to identify bias and its causes, and to remove …