| PaLM: Scaling Language Modeling with Pathways | Apr 5, 2022 | Auto DebuggingCode Generation | CodeCode Available | 2 | 5 |
| TurtleBench: Evaluating Top Language Models via Real-World Yes/No Puzzles | Oct 7, 2024 | Logical Reasoning | CodeCode Available | 2 | 5 |
| A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity | Feb 8, 2023 | Code GenerationHallucination | CodeCode Available | 1 | 5 |
| DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy | Oct 28, 2023 | Logical Reasoning | CodeCode Available | 1 | 5 |
| GLoRE: Evaluating Logical Reasoning of Large Language Models | Oct 13, 2023 | Logical ReasoningNatural Language Understanding | CodeCode Available | 1 | 5 |
| Deductive Verification of Chain-of-Thought Reasoning | Jun 6, 2023 | Logical Reasoning | CodeCode Available | 1 | 5 |
| Cross from Left to Right Brain: Adaptive Text Dreamer for Vision-and-Language Navigation | May 27, 2025 | Large Language ModelLogical Reasoning | CodeCode Available | 1 | 5 |
| LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models | Jan 1, 2024 | Code GenerationIn-Context Learning | CodeCode Available | 1 | 5 |
| FOLIO: Natural Language Reasoning with First-Order Logic | Sep 2, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 1 | 5 |
| DAGN: Discourse-Aware Graph Network for Logical Reasoning | Mar 26, 2021 | Logical ReasoningSentence | CodeCode Available | 1 | 5 |
| GSM-Symbolic: Understanding the Limitations of Mathematical Reasoning in Large Language Models | Oct 7, 2024 | GSM8KLogical Reasoning | CodeCode Available | 1 | 5 |
| From LSAT: The Progress and Challenges of Complex Reasoning | Aug 2, 2021 | Few-Shot LearningLogical Reasoning | CodeCode Available | 1 | 5 |
| Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning | May 21, 2023 | Abstract Meaning RepresentationContrastive Learning | CodeCode Available | 1 | 5 |
| Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language Models | Feb 16, 2025 | Language ModelingLanguage Modelling | CodeCode Available | 1 | 5 |
| Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization | Apr 9, 2025 | Logical ReasoningMathematical Reasoning | CodeCode Available | 1 | 5 |
| Counterfactual reasoning: Do language models need world knowledge for causal understanding? | Dec 6, 2022 | counterfactualCounterfactual Reasoning | CodeCode Available | 1 | 5 |
| Fact-driven Logical Reasoning for Machine Reading Comprehension | May 21, 2021 | Logical ReasoningMachine Reading Comprehension | CodeCode Available | 1 | 5 |
| ConditionalQA: A Complex Reading Comprehension Dataset with Conditional Answers | Oct 13, 2021 | Logical ReasoningQuestion Answering | CodeCode Available | 1 | 5 |
| Conditional and Modal Reasoning in Large Language Models | Jan 30, 2024 | Logical Reasoning | CodeCode Available | 1 | 5 |
| ExAIS: Executable AI Semantics | Feb 20, 2022 | Logical Reasoningvalid | CodeCode Available | 1 | 5 |
| Complex Logical Reasoning over Knowledge Graphs using Large Language Models | May 2, 2023 | Knowledge GraphsLogical Reasoning | CodeCode Available | 1 | 5 |
| Evolving Scientific Discovery by Unifying Data and Background Knowledge with AI Hilbert | Aug 18, 2023 | Equation DiscoveryLogical Reasoning | CodeCode Available | 1 | 5 |
| Counterfactual reasoning: Testing language models' understanding of hypothetical scenarios | May 26, 2023 | counterfactualCounterfactual Reasoning | CodeCode Available | 1 | 5 |
| Explicit Planning Helps Language Models in Logical Reasoning | Mar 28, 2023 | Logical ReasoningMultiple-choice | CodeCode Available | 1 | 5 |
| FaiRR: Faithful and Robust Deductive Reasoning over Natural Language | Mar 19, 2022 | Fact SelectionLogical Reasoning | CodeCode Available | 1 | 5 |
