Kevin Roitero |https://michaelsoprano.com/authors/kevin-roitero/Kevin RoiteroHugoBlox Kit (https://hugoblox.com)en-USThu, 18 Jun 2026 17:20:00 +0000Crowdsourced Fact-Checking for Misinformation: A Journey Through Nine Years of Research (2018–2026)https://michaelsoprano.com/talk/crowdsourced-fact-checking-for-misinformation-a-journey-through-nine-years-of-research-20182026/Thu, 18 Jun 2026 17:20:00 +0000https://michaelsoprano.com/talk/crowdsourced-fact-checking-for-misinformation-a-journey-through-nine-years-of-research-20182026/Analyzing AI Evaluation Benchmarks Through Information Retrieval and Network Sciencehttps://michaelsoprano.com/talk/analyzing-ai-evaluation-benchmarks-through-information-retrieval-and-network-science/Mon, 30 Mar 2026 13:31:00 +0000https://michaelsoprano.com/talk/analyzing-ai-evaluation-benchmarks-through-information-retrieval-and-network-science/Large Language Models as Assessors: On the Impact of Relevance Scaleshttps://michaelsoprano.com/talk/large-language-models-as-assessors-on-the-impact-of-relevance-scales/Mon, 30 Mar 2026 13:30:00 +0000https://michaelsoprano.com/talk/large-language-models-as-assessors-on-the-impact-of-relevance-scales/Analyzing AI Evaluation Benchmarks Through Information Retrieval and Network Sciencehttps://michaelsoprano.com/publication/conference-paper-ecir-2026-2/Wed, 25 Mar 2026 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-ecir-2026-2/Large Language Models as Assessors: On the Impact of Relevance Scaleshttps://michaelsoprano.com/publication/conference-paper-ecir-2026-1/Wed, 25 Mar 2026 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-ecir-2026-1/Large Language Models for Combinatorial Optimization: A Systematic Reviewhttps://michaelsoprano.com/publication/journal-paper-csur-2026/Mon, 16 Mar 2026 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-csur-2026/AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviewshttps://michaelsoprano.com/talk/ictir-2025-aidme-poster/Fri, 18 Jul 2025 13:30:00 +0000https://michaelsoprano.com/talk/ictir-2025-aidme-poster/AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviewshttps://michaelsoprano.com/publication/conference-paper-ictir2025/Fri, 18 Jul 2025 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-ictir2025/The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessmenthttps://michaelsoprano.com/talk/the-magnitude-of-truth-on-using-magnitude-estimation-for-truthfulness-assessment/Wed, 16 Jul 2025 14:50:00 +0000https://michaelsoprano.com/talk/the-magnitude-of-truth-on-using-magnitude-estimation-for-truthfulness-assessment/Efficiency and Effectiveness of LLM-Based Summarization of Evidence in Crowdsourced Fact-Checkinghttps://michaelsoprano.com/publication/conference-paper-sigir-2025-2/Sun, 13 Jul 2025 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-sigir-2025-2/PILs of Knowledge: A Synthetic Benchmark for Evaluating Question Answering Systems in Healthcarehttps://michaelsoprano.com/publication/conference-paper-sigir-2025-3/Sun, 13 Jul 2025 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-sigir-2025-3/The Magnitude of Truth: On Using Magnitude Estimation for Truthfulness Assessmenthttps://michaelsoprano.com/publication/conference-paper-sigir-2025-1/Sun, 13 Jul 2025 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-sigir-2025-1/AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviewshttps://michaelsoprano.com/talk/aidme-a-scalable-interpretable-framework-for-ai-aided-scoping-reviews/Mon, 23 Jun 2025 00:00:00 +0000https://michaelsoprano.com/talk/aidme-a-scalable-interpretable-framework-for-ai-aided-scoping-reviews/Agent-Based Healthcare Chatbots for Regional System Services: A Case Study in the Friuli-Venezia Giulia Regionhttps://michaelsoprano.com/publication/conference-paper-mie-2025/Fri, 16 May 2025 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-mie-2025/Report on the 14th Italian Information Retrieval Workshop (IIR 2024)https://michaelsoprano.com/publication/event-report-iir2024/Tue, 31 Dec 2024 00:00:00 +0000https://michaelsoprano.com/publication/event-report-iir2024/Report on the Hands-On PhD Course on Responsible AI from the Lens of an Information Access Researcherhttps://michaelsoprano.com/publication/event-report-resp-ai-course/Tue, 31 Dec 2024 00:00:00 +0000https://michaelsoprano.com/publication/event-report-resp-ai-course/Enhancing Fact-Checking: From Crowdsourced Validation to Integration with Large Language Modelshttps://michaelsoprano.com/publication/workshop-paper-iir-2024/Thu, 24 Oct 2024 00:00:00 +0000https://michaelsoprano.com/publication/workshop-paper-iir-2024/Deploying Complex Crowdsourcing Tasks Without Fear: An Introduction to Crowd_Framehttps://michaelsoprano.com/talk/deploying-complex-crowdsourcing-tasks-without-fear-an-introduction-to-crowd_frame/Tue, 17 Sep 2024 11:30:00 +0000https://michaelsoprano.com/talk/deploying-complex-crowdsourcing-tasks-without-fear-an-introduction-to-crowd_frame/Crowdsourcing Statement Classification to Enhance Information Quality Predictionhttps://michaelsoprano.com/publication/conference-paper-misdoom-2024/Sun, 01 Sep 2024 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-misdoom-2024/Longitudinal Loyalty: Understanding The Barriers To Running Longitudinal Studies On Crowdsourcing Platformshttps://michaelsoprano.com/publication/journal-paper-tsc-2024/Wed, 10 Jul 2024 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-tsc-2024/Crowdsourced Fact-checking: Does It Actually Work?https://michaelsoprano.com/publication/journal-paper-ipm-2024-2/Fri, 31 May 2024 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-ipm-2024-2/Cognitive Biases in Fact-Checking and Their Countermeasures: A Reviewhttps://michaelsoprano.com/publication/journal-paper-ipm-2024/Sat, 03 Feb 2024 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-ipm-2024/Towards a Conversational-Based Agent for Healthcarehttps://michaelsoprano.com/talk/towards-a-conversational-based-agent-for-healthcare/Thu, 26 Oct 2023 08:30:00 +0000https://michaelsoprano.com/talk/towards-a-conversational-based-agent-for-healthcare/Towards a Conversational-Based Agent for Health Serviceshttps://michaelsoprano.com/publication/workshop-paper-ital-ia-2023/Wed, 20 Sep 2023 00:00:00 +0000https://michaelsoprano.com/publication/workshop-paper-ital-ia-2023/Fact-Checking at Scale with Crowdsourcing Experiments and Lessons Learnedhttps://michaelsoprano.com/publication/workshop-paper-iir-2023/Sat, 05 Aug 2023 00:00:00 +0000https://michaelsoprano.com/publication/workshop-paper-iir-2023/Towards a Conversational-Based Agent for Health Serviceshttps://michaelsoprano.com/talk/towards-a-conversational-based-agent-for-health-services/Mon, 29 May 2023 00:00:00 +0000https://michaelsoprano.com/talk/towards-a-conversational-based-agent-for-health-services/How Many Crowd Workers Do I Need? On Statistical Power When Crowdsourcing Relevance Judgmentshttps://michaelsoprano.com/publication/journal-paper-tois-2023/Mon, 22 May 2023 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-tois-2023/A Neural Model to Jointly Predict and Explain Truthfulness of Statementshttps://michaelsoprano.com/publication/journal-paper-jdiq-2022/Sat, 09 Jul 2022 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-jdiq-2022/The Effects of Crowd Worker Biases in Fact-Checking Taskshttps://michaelsoprano.com/publication/conference-paper-facct-2022/Tue, 21 Jun 2022 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-facct-2022/Crowd_Frame: A Simple and Complete Framework to Deploy Complex Crowdsourcing Tasks Off-the-Shelfhttps://michaelsoprano.com/talk/crowd_frame-a-simple-and-complete-framework-to-deploy-complex-crowdsourcing-tasks-off-the-shelf/Wed, 23 Feb 2022 00:00:00 +0000https://michaelsoprano.com/talk/crowd_frame-a-simple-and-complete-framework-to-deploy-complex-crowdsourcing-tasks-off-the-shelf/Crowd_Frame: A Simple and Complete Framework to Deploy Complex Crowdsourcing Tasks Off-the-Shelfhttps://michaelsoprano.com/publication/conference-paper-wsdm-2022/Tue, 15 Feb 2022 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-wsdm-2022/The Many Dimensions of Truthfulness: Crowdsourcing Misinformation Assessments on a Multidimensional Scalehttps://michaelsoprano.com/publication/journal-paper-ipm-2021/Mon, 01 Nov 2021 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-ipm-2021/E-BART: Jointly Predicting and Explaining Truthfulnesshttps://michaelsoprano.com/publication/conference-paper-tto-2021/Sat, 16 Oct 2021 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-tto-2021/Can The Crowd Judge Truthfulness? A Longitudinal Study on Recent Misinformation About COVID-19https://michaelsoprano.com/publication/journal-paper-pauc-2021/Thu, 16 Sep 2021 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-pauc-2021/The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?https://michaelsoprano.com/talk/the-covid-19-infodemic-can-the-crowd-judge-recent-misinformation-objectively/Mon, 19 Oct 2020 00:00:00 +0000https://michaelsoprano.com/talk/the-covid-19-infodemic-can-the-crowd-judge-recent-misinformation-objectively/The COVID-19 Infodemic: Can the Crowd Judge Recent Misinformation Objectively?https://michaelsoprano.com/publication/conference-paper-cikm-2020/Mon, 19 Oct 2020 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-cikm-2020/Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor's Backgroundhttps://michaelsoprano.com/publication/conference-paper-sigir-2020/Sat, 25 Jul 2020 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-sigir-2020/Can The Crowd Identify Misinformation Objectively? The Effects of Judgment Scale and Assessor’s Backgroundhttps://michaelsoprano.com/talk/can-the-crowd-identify-misinformation-objectively-the-effects-of-judgment-scale-and-assessors-background/Sat, 25 Jul 2020 00:00:00 +0000https://michaelsoprano.com/talk/can-the-crowd-identify-misinformation-objectively-the-effects-of-judgment-scale-and-assessors-background/Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Modelhttps://michaelsoprano.com/talk/bias-and-fairness-in-effectiveness-evaluation-by-means-of-network-analysis-and-mixture-model/Mon, 16 Sep 2019 00:00:00 +0000https://michaelsoprano.com/talk/bias-and-fairness-in-effectiveness-evaluation-by-means-of-network-analysis-and-mixture-model/Bias and Fairness in Effectiveness Evaluation by Means of Network Analysis and Mixture Modelshttps://michaelsoprano.com/publication/workshop-paper-iir-2019/Mon, 16 Sep 2019 00:00:00 +0000https://michaelsoprano.com/publication/workshop-paper-iir-2019/HITS Hits Readersourcing: Validating Peer Review Alternatives Using Network Analysishttps://michaelsoprano.com/publication/workshop-paper-birnld-2019/Thu, 25 Jul 2019 00:00:00 +0000https://michaelsoprano.com/publication/workshop-paper-birnld-2019/Reproduce and Improve: An Evolutionary Approach to Select a Few Good Topics for Information Retrieval Evaluationhttps://michaelsoprano.com/publication/journal-paper-jdiq-2018/Sat, 01 Sep 2018 00:00:00 +0000https://michaelsoprano.com/publication/journal-paper-jdiq-2018/Effectiveness Evaluation with a Subset of Topics: A Practical Approachhttps://michaelsoprano.com/publication/conference-paper-sigir-2018/Sun, 08 Jul 2018 00:00:00 +0000https://michaelsoprano.com/publication/conference-paper-sigir-2018/