Large Language Models as Assessors: On the Impact of Relevance Scales
Poster - The 48th European Conference on Information Retrieval (ECIR 2026). Delft, The Netherlands.
riccardo-zamolo
•
Mar 30, 2026 13:30 — 14:30
•
1 min read
Analyzing AI Evaluation Benchmarks Through Information Retrieval and Network Science
Poster - The 48th European Conference on Information Retrieval (ECIR 2026). Delft, The Netherlands.
gaia-simeoni
Large Language Models as Assessors: On the Impact of Relevance Scales
Traditionally, relevance judgments have relied on human annotators, but recent advances in Large Language Models (LLMs) have prompted growing interest in their use as a proxy for …
riccardo-zamolo
Analyzing AI Evaluation Benchmarks Through Information Retrieval and Network Science
Many analyses have been performed on Information Retrieval (IR) evaluation benchmarks. Benchmarking also plays a central role in evaluating the capabilities of Large Language …
gaia-simeoni
Large Language Models for Combinatorial Optimization: A Systematic Review
This systematic review explores the application of Large Language Models (LLMs) in Combinatorial Optimization (CO). We report our findings using the Preferred Reporting Items for …
francesca-da-ros
AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviews
Poster - The 15th International Conference on Innovative Concepts and Theories in Information Retrieval. Padua, Italy.
AIDME: A Scalable, Interpretable Framework for AI-Aided Scoping Reviews
Scientific publishing is expanding rapidly across disciplines, making it increasingly difficult for researchers to organize, filter, and synthesize the literature. Systematic …
PILs of Knowledge: A Synthetic Benchmark for Evaluating Question Answering Systems in Healthcare
Patient Information Leaflets (PILs) provide essential information about medication usage, side effects, precautions, and interactions, making them a valuable resource for Question …
riccardo-lunardi
Efficiency and Effectiveness of LLM-Based Summarization of Evidence in Crowdsourced Fact-Checking
Evaluating the truthfulness of online content is critical for combating misinformation. This study examines the efficiency and effectiveness of crowdsourced truthfulness …
kevin-roitero
Report on the Hands-On PhD Course on Responsible AI from the Lens of an Information Access Researcher
While the concept of responsible AI is becoming more and more popular, practitioners and researchers may often struggle to characterize responsible practices in their own work. …
damiano-spina