crowdsourcing

The Effects of Crowd Worker Biases in Fact-Checking Tasks

Due to the increasing amount of information shared online every day, the need for sound and reliable ways of distinguishing between trustworthy and non-trustworthy information is as present as ever. One technique for performing fact-checking at scale …

Social Computing - 2021/2022

Bachelor's Degree in Internet of Things, Big Data & Web at the University of Udine. Academic Year 2020/2021. Lectures: 6. Hours: 12

Crowd_Frame: A Simple and Complete Framework to Deploy Complex Crowdsourcing Tasks Off-the-Shelf

Conference Talk - The 15th ACM International Conference on Web Search and Data Mining. Held remotely due to COVID-19 (pre-recorded contribution).

Crowd_Frame: A Simple and Complete Framework to Deploy Complex Crowdsourcing Tasks Off-the-Shelf

Due to their relatively low cost and ability to scale, crowdsourcing based approaches are widely used to collect a large amount of human annotated data. To this aim, multiple crowdsourcing platforms exist, where requesters can upload tasks and …

The Many Dimensions of Truthfulness: Crowdsourcing Misinformation Assessments on a Multidimensional Scale

Recent work has demonstrated the viability of using crowdsourcing as a tool for evaluating the truthfulness of public statements. Under certain conditions such as: (1) having a balanced set of workers with different backgrounds and cognitive …

Can The Crowd Judge Truthfulness? A Longitudinal Study on Recent Misinformation About COVID-19

Recently, the misinformation problem has been addressed with a crowdsourcing-based approach: to assess the truthfulness of a statement, instead of relying on a few experts, a crowd of non-expert is exploited. We study whether crowdsourcing is an …

Social Computing - 2020/2021

Bachelor's Degree in Internet of Things, Big Data & Web at the University of Udine. Academic Year 2020/2021. Lectures: 6. Hours: 12

The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?

Conference Talk - The 29th ACM International Conference on Information and Knowledge Management (CIKM 2020). October 19-23, 2020. Galway, Ireland. Online. Held remotely due to COVID-19 (pre-recorded contribution).

The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?

Misinformation is an ever increasing problem that is difficult to solve for the research community and has a negative impact on the society at large. Very recently, the problem has been addressed with a crowdsourcing-based approach to scale up …

Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor's Background

Truthfulness judgments are a fundamental step in the process of fighting misinformation, as they are crucial to train and evaluate classifiers that automatically distinguish true and false statements. Usually such judgments are made by experts, like …