misinformation

AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviews

Poster Presentation - The 48th International ACM SIGIR Conference on Research and Development in Information Retrieval. Padua, Italy.

AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviews

Scientific publishing is expanding rapidly across disciplines, making it increasingly difficult for researchers to organize, filter, and synthesize the literature. Systematic reviews address this challenge through structured analysis, but the early …

The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment

Conference Talk - The 48th International ACM SIGIR Conference on Research and Development in Information Retrieval. Padua, Italy.

The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessment

Evaluating the truthfulness of online content is critical for combating misinformation. This study examines the efficiency and effectiveness of crowdsourced truthfulness assessments through a comparative analysis of two approaches: one involving …

Enhancing Fact-Checking: From Crowdsourced Validation to Integration with Large Language Models

Information retrieval effectiveness evaluation is often carried out by means of test collections. Many works investigated possible sources of bias in such an approach. We propose a systematic approach to identify bias and its causes, and to remove …

Crowdsourced Fact-checking: Does It Actually Work?

There is an important ongoing effort aimed to tackle misinformation and to perform reliable fact-checking by employing human assessors at scale, with a crowdsourcing-based approach. Previous studies on the feasibility of employing crowdsourcing for …

Cognitive Biases in Fact-Checking and Their Countermeasures: A Review

The increase of the amount of misinformation spread every day online is a huge threat to the society. Organizations and researchers are working to contrast this misinformation plague. In this setting, human assessors are indispensable to correctly …

Fact-Checking at Scale with Crowdsourcing Experiments and Lessons Learned

In this paper, we present our journey in exploring the use of crowdsourcing for fact-checking. We discuss our early experiments aimed towards the identification of the best possible setting for misinformation assessment using crowdsourcing. Our …

The Effects of Crowd Worker Biases in Fact-Checking Tasks

Due to the increasing amount of information shared online every day, the need for sound and reliable ways of distinguishing between trustworthy and non-trustworthy information is as present as ever. One technique for performing fact-checking at scale …

The Many Dimensions of Truthfulness: Crowdsourcing Misinformation Assessments on a Multidimensional Scale

Recent work has demonstrated the viability of using crowdsourcing as a tool for evaluating the truthfulness of public statements. Under certain conditions such as: (1) having a balanced set of workers with different backgrounds and cognitive …