Publications

Collecting Cost-Effective, High-Quality Truthfulness Assessments with LLM Summarized Evidence
Kevin Roitero, Dustin Wright, Michael Soprano, Isabelle Augenstein, Stefano Mizzaro
Cite DOI
Report on the Hands-On PhD Course on Responsible AI from the Lens of an Information Access Researcher
Damiano Spina, Kevin Roitero, Stefano Mizzaro, Vincenzo Della Mea, Francesca Da Ros, Michael Soprano, Hafsa Akebli, Alex Falcon, Mehdi Fasihi, Alessio Fiorin, David La Barbera, Daniele Lizzio Bosco, Riccardo Lunardi, Alberto Marturano, Zaka-Ud-Din Muhammad, Francesco Nascimbeni, Moritz Nottebaum, Massimiliano Pascoli, Mihai Horia Popescu, Laura Rasotto, Mubashara Rehman, Francesco Taverna, Biagio Tomasetig, Alessandro Tremamunno
PDF Cite
Report on the 14th Italian Information Retrieval Workshop (IIR 2024)
Eddy Maddalena, Stefano Mizzaro, Kevin Roitero, Marco Viviani, David La Barbera, Sandip Modha, Gabriella Pasi, Francesca Da Ros, Michael Soprano
PDF Cite
Enhancing Fact-Checking: From Crowdsourced Validation to Integration with Large Language Models
Kevin Roitero, Michael Soprano, David La Barbera, Eddy Maddalena, Stefano Mizzaro
PDF Cite
Crowdsourcing Statement Classification to Enhance Information Quality Prediction
Jaspreet Singh, Michael Soprano, Kevin Roitero, Davide Ceolin
Cite DOI
Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platforms
Michael Soprano, Kevin Roitero, Ujwal Gadiraju, Eddy Maddalena, Gianluca Demartini
Cite DOI
Crowdsourced Fact-checking: Does It Actually Work?
David La Barbera, Eddy Maddalena, Michael Soprano, Kevin Roitero, Gianluca Demartini, Davide Ceolin, Damiano Spina, Stefano Mizzaro
Cite DOI
Cognitive Biases in Fact-Checking and Their Countermeasures: A Review
Michael Soprano, Kevin Roitero, David La Barbera, Davide Ceolin, Damiano Spina, Gianluca Demartini, Stefano Mizzaro
Cite DOI
Towards a Conversational-Based Agent for Health Services
Michael Soprano, Kevin Roitero, Vincenzo Della Mea, Stefano Mizzaro
PDF Cite
Fact-Checking at Scale with Crowdsourcing Experiments and Lessons Learned
David La Barbera, Michael Soprano, Kevin Roitero, Eddy Maddalena, Stefano Mizzaro
PDF Cite
How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments
Kevin Roitero, David La Barbera, Michael Soprano, Gianluca Demartini, Stefano Mizzaro, Tetsuya Sakai
Cite DOI
Transparent assessment of information quality of online reviews using formal argumentation theory
Davide Ceolin, Giuseppe Primiero, Michael Soprano, Jan Wielemaker
Cite DOI
A Neural Model to Jointly Predict and Explain Truthfulness of Statements
Erik Brand, Kevin Roitero, Michael Soprano, Afshin Rahimi, Gianluca Demartini
Cite DOI
The Effects of Crowd Worker Biases in Fact-Checking Tasks
Tim Draws, David La Barbera, Michael Soprano, Kevin Roitero, Davide Ceolin, Alessandro Checco, Stefano Mizzaro
Cite DOI
Crowd_Frame: A Simple and Complete Framework to Deploy Complex Crowdsourcing Tasks Off-the-Shelf
Michael Soprano, Kevin Roitero, Francesco Bombassei De Bona, Stefano Mizzaro
Cite DOI
The Many Dimensions of Truthfulness: Crowdsourcing Misinformation Assessments on a Multidimensional Scale
Michael Soprano, Kevin Roitero, David La Barbera, Davide Ceolin, Damiano Spina, Stefano Mizzaro
Cite DOI
E-BART: Jointly Predicting and Explaining Truthfulness
Erik Brand, Kevin Roitero, Michael Soprano, Gianluca Demartini
PDF Cite
Can The Crowd Judge Truthfulness? A Longitudinal Study on Recent Misinformation About COVID-19
Kevin Roitero, Michael Soprano, Beatrice Portelli, Massimiliano De Luise, Vincenzo Della Mea, Giuseppe Serra, Stefano Mizzaro, Gianluca Demartini
Cite DOI
Assessing the Quality of Online Reviews Using Formal Argumentation Theory
Davide Ceolin, Giuseppe Primiero, Jan Wielemaker, Michael Soprano
Cite DOI
The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?
Kevin Roitero, Michael Soprano, Beatrice Portelli, Damiano Spina, Vincenzo Della Mea, Giuseppe Serra, Stefano Mizzaro, Gianluca Demartini
Cite DOI
Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor's Background
Kevin Roitero, Michael Soprano, Shaoyang Fan, Damiano Spina, Stefano Mizzaro, Gianluca Demartini
Cite DOI
Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Models
Michael Soprano, Kevin Roitero, Stefano Mizzaro
PDF Cite
HITS Hits Readersourcing: Validating Peer Review Alternatives Using Network Analysis
Michael Soprano, Kevin Roitero, Stefano Mizzaro
PDF Cite
Crowdsourcing Peer Review: As We May Do
Michael Soprano, Stefano Mizzaro
Cite DOI
Crowdsourcing Peer Review in the Digital Humanities?
Michael Soprano, Stefano Mizzaro
PDF Cite
Reproduce and Improve: An Evolutionary Approach to Select a Few Good Topics for Information Retrieval Evaluation
Kevin Roitero, Michael Soprano, Andrea Brunello, Stefano Mizzaro
Cite DOI
Effectiveness Evaluation with a Subset of Topics: A Practical Approach
Kevin Roitero, Michael Soprano, Stefano Mizzaro
Cite DOI