fact-checking

The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment

Conference Talk - The 48th International ACM SIGIR Conference on Research and Development in Information Retrieval. Padua, Italy.

The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment

Evaluating the truthfulness of online content is critical for combating misinformation. This study examines the efficiency and effectiveness of crowdsourced truthfulness assessments through a comparative analysis of two approaches: one involving …

Enhancing Fact-Checking: From Crowdsourced Validation to Integration with Large Language Models

Information retrieval effectiveness evaluation is often carried out by means of test collections. Many works investigated possible sources of bias in such an approach. We propose a systematic approach to identify bias and its causes, and to remove …

Crowdsourced Fact-checking: Does It Actually Work?

There is an important ongoing effort aimed to tackle misinformation and to perform reliable fact-checking by employing human assessors at scale, with a crowdsourcing-based approach. Previous studies on the feasibility of employing crowdsourcing for …

Cognitive Biases in Fact-Checking and Their Countermeasures: A Review

The increase of the amount of misinformation spread every day online is a huge threat to the society. Organizations and researchers are working to contrast this misinformation plague. In this setting, human assessors are indispensable to correctly …

Fact-Checking at Scale with Crowdsourcing Experiments and Lessons Learned

In this paper, we present our journey in exploring the use of crowdsourcing for fact-checking. We discuss our early experiments aimed towards the identification of the best possible setting for misinformation assessment using crowdsourcing. Our …