Paper-Conference

Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor's Background

Truthfulness judgments are a fundamental step in the process of fighting misinformation, as they are crucial to train and evaluate classifiers that automatically distinguish true …

kevin-roitero

Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Models

Information retrieval effectiveness evaluation is often carried out by means of test collections. Many works investigated possible sources of bias in such an approach. We propose a …

avatar
Michael Soprano

HITS Hits Readersourcing: Validating Peer Review Alternatives Using Network Analysis

Peer review is a well known mechanism exploited within the scholarly publishing process to ensure the quality of scientific literature. Such a mechanism, despite being well …

avatar
Michael Soprano

Crowdsourcing Peer Review: As We May Do

This paper describes Readersourcing 2.0, an ecosystem providing an implementation of the Readersourcing approach proposed by Mizzaro [10]. Readersourcing is proposed as an …

avatar
Michael Soprano

Crowdsourcing Peer Review in the Digital Humanities?

We propose an alternative approach to the standard peer review activity that aims to exploit the otherwise lost opinions of readers of publications which is called Readersourcing, …

avatar
Michael Soprano

Effectiveness Evaluation with a Subset of Topics: A Practical Approach

Several researchers have proposed to reduce the number of topics used in TREC-like initiatives. One research direction that has been pursued is what is the optimal topic subset of …

kevin-roitero