Analyzing AI Evaluation Benchmarks Through Information Retrieval and Network Science
Poster - The 48th European Conference on Information Retrieval (ECIR 2026). Delft, The Netherlands.
gaia-simeoni
•
Mar 30, 2026 13:30 — 14:30
•
1 min read
Large Language Models as Assessors: On the Impact of Relevance Scales
Traditionally, relevance judgments have relied on human annotators, but recent advances in Large Language Models (LLMs) have prompted growing interest in their use as a proxy for …
riccardo-zamolo
Analyzing AI Evaluation Benchmarks Through Information Retrieval and Network Science
Many analyses have been performed on Information Retrieval (IR) evaluation benchmarks. Benchmarking also plays a central role in evaluating the capabilities of Large Language …
gaia-simeoni
PILs of Knowledge: A Synthetic Benchmark for Evaluating Question Answering Systems in Healthcare
Patient Information Leaflets (PILs) provide essential information about medication usage, side effects, precautions, and interactions, making them a valuable resource for Question …
riccardo-lunardi