| Efficient Federated Search for Retrieval-Augmented Generation | Feb 26, 2025 | MMLURAG | —Unverified | 0 |
| WiCkeD: A Simple Method to Make Multiple Choice Benchmarks More Challenging | Feb 25, 2025 | MMLUMultiple-choice | CodeCode Available | 0 |
| Correlating and Predicting Human Evaluations of Language Models from Natural Language Processing Benchmarks | Feb 24, 2025 | 2kARC | —Unverified | 0 |
| Distributional Scaling Laws for Emergent Capabilities | Feb 24, 2025 | MMLU | —Unverified | 0 |
| Evaluating Expert Contributions in a MoE LLM for Quiz-Based Tasks | Feb 24, 2025 | Mixture-of-ExpertsMMLU | —Unverified | 0 |
| Detecting Benchmark Contamination Through Watermarking | Feb 24, 2025 | ARCMMLU | —Unverified | 0 |
| Swallowing the Poison Pills: Insights from Vulnerability Disparity Among LLMs | Feb 23, 2025 | Data PoisoningDiagnostic | —Unverified | 0 |
| Obliviate: Efficient Unmemorization for Protecting Intellectual Property in Large Language Models | Feb 20, 2025 | HellaSwagMemorization | —Unverified | 0 |
| Earlier Tokens Contribute More: Learning Direct Preference Optimization From Temporal Decay Perspective | Feb 20, 2025 | GSM8KMath | CodeCode Available | 0 |
| Triangulating LLM Progress through Benchmarks, Games, and Cognitive Tests | Feb 20, 2025 | Logical ReasoningMMLU | —Unverified | 0 |
| None of the Others: a General Technique to Distinguish Reasoning from Memorization in Multiple-Choice LLM Evaluation Benchmarks | Feb 18, 2025 | MathMemorization | —Unverified | 0 |
| Language Complexity Measurement as a Noisy Zero-Shot Proxy for Evaluating LLM Performance | Feb 17, 2025 | BenchmarkingDependency Parsing | —Unverified | 0 |
| Towards Fully Exploiting LLM Internal States to Enhance Knowledge Boundary Perception | Feb 17, 2025 | MMLUNatural Questions | —Unverified | 0 |
| TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages | Feb 16, 2025 | Machine TranslationMMLU | CodeCode Available | 1 |
| Leveraging Uncertainty Estimation for Efficient LLM Routing | Feb 16, 2025 | GSM8KMMLU | —Unverified | 0 |
| OctoTools: An Agentic Framework with Extensible Tools for Complex Reasoning | Feb 16, 2025 | MedQAMMLU | —Unverified | 0 |
| ORI: O Routing Intelligence | Feb 14, 2025 | ARCMMLU | —Unverified | 0 |
| Cost-Saving LLM Cascades with Early Abstention | Feb 13, 2025 | GSM8KMMLU | —Unverified | 0 |
| Selective Self-to-Supervised Fine-Tuning for Generalization in Large Language Models | Feb 12, 2025 | Mathematical ReasoningMMLU | —Unverified | 0 |
| Forget What You Know about LLMs Evaluations - LLMs are Like a Chameleon | Feb 11, 2025 | MMLU | CodeCode Available | 0 |
| OpenGrok: Enhancing SNS Data Processing with Distilled Knowledge and Mask-like Mechanisms | Feb 11, 2025 | Knowledge DistillationMMLU | CodeCode Available | 0 |
| RoToR: Towards More Reliable Responses for Order-Invariant Inputs | Feb 10, 2025 | Graph Question AnsweringMMLU | CodeCode Available | 0 |
| Tokenization Standards for Linguistic Integrity: Turkish as a Benchmark | Feb 10, 2025 | MMLUMorphological Analysis | —Unverified | 0 |
| LM2: Large Memory Models | Feb 9, 2025 | DecoderMMLU | CodeCode Available | 1 |
| FRAMES: Boosting LLMs with A Four-Quadrant Multi-Stage Pretraining Strategy | Feb 8, 2025 | MMLU | —Unverified | 0 |