Right Answer, Wrong Score: Uncovering the Inconsistencies of LLM Evaluation in Multiple-Choice Question Answering
Paper
•
2503.14996
•
Published
•
3
Simone Conia
s-conia
AI & ML interests
Natural Language Processing, Multilinguality, Knowledge Graphs, Semantics, Large Language Models
Recent Activity
updated
a Space
14 days ago
principled-intelligence/README
published
a Space
14 days ago
principled-intelligence/README
liked
a dataset
about 2 months ago
BSC-LT/multi_lmentry
Organizations
authored
a
paper
6 months ago
authored
6
papers
11 months ago
ZEBRA: Zero-Shot Example-Based Retrieval Augmentation for Commonsense Question Answering
Paper
•
2410.05077
•
Published
•
5
Echoes from Alexandria: A Large Resource for Multilingual Book Summarization
Paper
•
2306.04334
•
Published
•
2
Semantic Role Labeling Meets Definition Modeling: Using Natural Language to Describe Predicate-Argument Structures
Paper
•
2212.01094
•
Published
•
2
Do Large Language Models Have an English Accent? Evaluating and Improving the Naturalness of Multilingual LLMs
Paper
•
2410.15956
•
Published
Exploring Non-Verbal Predicates in Semantic Role Labeling: Challenges and Opportunities
Paper
•
2307.01870
•
Published
Entity Disambiguation with Entity Definitions
Paper
•
2210.05648
•
Published
authored
a
paper
over 1 year ago