crowdsourcing annotation

Collecting Cost-Effective, High-Quality Truthfulness Assessments with LLM Summarized Evidence

With the degradation of guardrails against mis- and disinformation online, it is more critical than ever to be able to effectively combat it. In this paper, we explore the efficiency and effectiveness of using crowd-sourced truthfulness assessments …

Crowdsourcing Statement Classification to Enhance Information Quality Prediction

This paper explores the use of crowdsourcing to classify statement types in film reviews to assess their information quality. Employing the Argument Type Identification Procedure which uses the Periodic Table of Arguments to categorize arguments, the …