SOTAVerified

Multiple-choice

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 1107 papers

TitleStatusHype
Big-Math: A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language ModelsCode2
AutoLogi: Automated Generation of Logic Puzzles for Evaluating Reasoning Abilities of Large Language ModelsCode1
The Lazy Student's Dream: ChatGPT Passing an Engineering Course on Its Own—0
LegalBench.PT: A Benchmark for Portuguese Law—0
Moving Beyond Medical Exam Questions: A Clinician-Annotated Dataset of Real-World Tasks and Ambiguity in Mental HealthcareCode0
Wrong Answers Can Also Be Useful: PlausibleQA -- A Large-Scale QA Dataset with Answer Plausibility ScoresCode0
MHQA: A Diverse, Knowledge Intensive Mental Health Question Answering Challenge for Language Models—0
Do LLMs Make Mistakes Like Students? Exploring Natural Alignment between Language Models and Human Error Patterns—0
Unveiling Cultural Blind Spots: Analyzing the Limitations of mLLMs in Procedural Text Comprehension—0
Fundamental Limitations in Defending LLM Finetuning APIs—0
MCQA-Eval: Efficient Confidence Evaluation in NLG with Gold-Standard Correctness Labels—0
Is This Collection Worth My LLM's Time? Automatically Measuring Information Potential in Text Corpora—0
Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh—0
Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above—0
Towards Geo-Culturally Grounded LLM Generations—0
VITAL: A New Dataset for Benchmarking Pluralistic Alignment in Healthcare—0
OCCULT: Evaluating Large Language Models for Offensive Cyber Operation Capabilities—0
None of the Others: a General Technique to Distinguish Reasoning from Memorization in Multiple-Choice LLM Evaluation Benchmarks—0
Beyond Profile: From Surface-Level Facts to Deep Persona Simulation in LLMs—0
Multi-Modal Retrieval Augmentation for Open-Ended and Knowledge-Intensive Video Question Answering—0
LogiDynamics: Unraveling the Dynamics of Logical Inference in Large Language Model Reasoning—0
Mind the Confidence Gap: Overconfidence, Calibration, and Distractor Effects in Large Language ModelsCode1
VisCon-100K: Leveraging Contextual Web Data for Fine-tuning Vision Language Models—0
Objective quantification of mood states using large language models—0
Truth Knows No Language: Evaluating Truthfulness Beyond EnglishCode0
SB-Bench: Stereotype Bias Benchmark for Large Multimodal Models—0
A Semantic Parsing Algorithm to Solve Linear Ordering Problems—0
Break the Checkbox: Challenging Closed-Style Evaluations of Cultural Alignment in LLMs—0
PerCul: A Story-Driven Cultural Evaluation of LLMs in Persian—0
Tokenization Standards for Linguistic Integrity: Turkish as a Benchmark—0
HSI: Head-Specific Intervention Can Induce Misaligned AI Coordination in Large Language ModelsCode0
Investigating the Shortcomings of LLMs in Step-by-Step Legal ReasoningCode0
ARR: Question Answering with Large Language Models via Analyzing, Retrieving, and ReasoningCode0
The Order Effect: Investigating Prompt Sensitivity to Input Order in LLMs—0
LLMs to Support a Domain Specific Knowledge Assistant—0
TUMTraffic-VideoQA: A Benchmark for Unified Spatio-Temporal Video Understanding in Traffic ScenesCode1
Evalita-LLM: Benchmarking Large Language Models on Italian—0
The Use of Artificial Intelligence Tools in Assessing Content Validity: A Comparative Study with Human Experts—0
CoddLLM: Empowering Large Language Models for Data Analytics—0
InnerThoughts: Disentangling Representations and Predictions in Large Language Models—0
Town Hall Debate Prompting: Enhancing Logical Reasoning in LLMs through Multi-Persona Interaction—0
Inferring from Logits: Exploring Best Practices for Decoding-Free Generative Candidate Selection—0
Attribution analysis of legal language as used by LLM—0
Options-Aware Dense Retrieval for Multiple-Choice query Answering—0
HardML: A Benchmark For Evaluating Data Science And Machine Learning knowledge and reasoning in AI—0
LLM Evaluation Based on Aerospace Manufacturing Expertise: Automated Generation and Multi-Model Question Answering—0
LongReason: A Synthetic Long-Context Reasoning Benchmark via Context Expansion—0
Option-ID Based Elimination For Multiple Choice QuestionsCode0
Humanity's Last Exam—0
Auto-Evaluation: A Critical Measure in Driving Improvements in Quality and Safety of AI-Generated Lesson Resources—0
Show:102550
← PrevPage 4 of 23Next →

No leaderboard results yet.