The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment
Conference Talk - The 48th International ACM SIGIR Conference on Research and Development in Information Retrieval. Padua, Italy.
David La Barbera
The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment
Assessing the truthfulness of information is a critical task in fact-checking and is typically performed using binary or coarse ordinal scales (2–6 levels), though fine-grained …
Report on the Hands-On PhD Course on Responsible AI from the Lens of an Information Access Researcher
While the concept of responsible AI is becoming more and more popular, practitioners and researchers may often struggle to characterize responsible practices in their own work. …
damiano-spina
Report on the 14th Italian Information Retrieval Workshop (IIR 2024)
IIR 2024, the 14th Italian Information Retrieval Workshop, served as the annual event for the IR and RS communities both in Italy and collaborating with Italian research …
eddy-maddalena
Enhancing Fact-Checking: From Crowdsourced Validation to Integration with Large Language Models
This extended abstract presents results from two recent studies aimed at enhancing the practical application and effectiveness of fact-checking systems. The first study …
kevin-roitero
Crowdsourced Fact-checking: Does It Actually Work?
There is an important ongoing effort aimed to tackle misinformation and to perform reliable fact-checking by employing human assessors at scale, with a crowdsourcing-based …
david-la-barbera
Cognitive Biases in Fact-Checking and Their Countermeasures: A Review
The increase of the amount of misinformation spread every day online is a huge threat to the society. Organizations and researchers are working to contrast this misinformation …
Fact-Checking at Scale with Crowdsourcing: Experiments and Lessons Learned
In this paper, we present our journey in exploring the use of crowdsourcing for fact-checking. We discuss our early experiments aimed towards the identification of the best …
david-la-barbera
How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgments
To scale the size of Information Retrieval collections, crowdsourcing has become a common way to collect relevance judgments at scale. Crowdsourcing experiments usually employ …
kevin-roitero
The Effects of Crowd Worker Biases in Fact-Checking Tasks
Due to the increasing amount of information shared online every day, the need for sound and reliable ways of distinguishing between trustworthy and non-trustworthy information is …
tim-draws