Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Model
Workshop Talk - Italian Information Retrieval Workshop (IIR 2019). September 16, 2019, Padua, Italy.
Michael Soprano
Researcher
Welcome to my personal webpage. I am a Researcher at the University of Udine and a member of the Social, Mobile, Data & Crowd Laboratory . I hold a PhD in Computer Science and Mathematical and Physical Sciences.
My research interests include Human Computation, Crowdsourcing, Information Retrieval, and Large Language Models. My current work focuses in particular on the use of crowdsourcing to address the growing challenge of misinformation.
You can explore my PhD thesis (written in English), as well as my Master’s , Bachelor’s , and High School theses (written in Italian).
HITS Hits Readersourcing: Validating Peer Review Alternatives Using Network Analysis
Peer review is a well known mechanism exploited within the scholarly publishing process to ensure the quality of scientific literature. Such a mechanism, despite being well …
Crowdsourcing Peer Review: As We May Do
This paper describes Readersourcing 2.0, an ecosystem providing an implementation of the Readersourcing approach proposed by Mizzaro [10]. Readersourcing is proposed as an …
Crowdsourcing Peer Review in the Digital Humanities?
We propose an alternative approach to the standard peer review activity that aims to exploit the otherwise lost opinions of readers of publications which is called Readersourcing, …
Reproduce and Improve: An Evolutionary Approach to Select a Few Good Topics for Information Retrieval Evaluation
Effectiveness evaluation of information retrieval systems by means of a test collection is a widely used methodology. However, it is rather expensive in terms of resources, time, …
kevin-roitero
Effectiveness Evaluation with a Subset of Topics: A Practical Approach
Several researchers have proposed to reduce the number of topics used in TREC-like initiatives. One research direction that has been pursued is what is the optimal topic subset of …
kevin-roitero