The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment
Conference Talk - The 48th International ACM SIGIR Conference on Research and Development in Information Retrieval. Padua, Italy.
David La Barbera
The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment
Evaluating the truthfulness of online content is critical for combating misinformation. This study examines the efficiency and effectiveness of crowdsourced truthfulness …
Report on the Hands-On PhD Course on Responsible AI from the Lens of an Information Access Researcher
While the concept of responsible AI is becoming more and more popular, practitioners and researchers may often struggle to characterize responsible practices in their own work. …
damiano-spina
Report on the 14th Italian Information Retrieval Workshop (IIR 2024)
IIR 2024, the 14th Italian Information Retrieval Workshop, served as the annual event for the IR and RS communities both in Italy and collaborating with Italian research …
eddy-maddalena
Enhancing Fact-Checking: From Crowdsourced Validation to Integration with Large Language Models
Information retrieval effectiveness evaluation is often carried out by means of test collections. Many works investigated possible sources of bias in such an approach. We propose a …
kevin-roitero
Crowdsourced Fact-checking: Does It Actually Work?
There is an important ongoing effort aimed to tackle misinformation and to perform reliable fact-checking by employing human assessors at scale, with a crowdsourcing-based …
david-la-barbera
Cognitive Biases in Fact-Checking and Their Countermeasures: A Review
The increase of the amount of misinformation spread every day online is a huge threat to the society. Organizations and researchers are working to contrast this misinformation …
Fact-Checking at Scale with Crowdsourcing Experiments and Lessons Learned
In this paper, we present our journey in exploring the use of crowdsourcing for fact-checking. We discuss our early experiments aimed towards the identification of the best …
david-la-barbera
How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments
To scale the size of Information Retrieval collections, crowdsourcing has become a common way to collect relevance judgments at scale. Crowdsourcing experiments usually employ …
kevin-roitero
The Effects of Crowd Worker Biases in Fact-Checking Tasks
Due to the increasing amount of information shared online every day, the need for sound and reliable ways of distinguishing between trustworthy and non-trustworthy information is …
tim-draws