SOTAVerified

Logical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 501–550 of 747 papers

TitleStatusHype
Compositional Distributional Cognition—0
Consistent CCG Parsing over Multiple Sentences for Improved Logical Reasoning—0
Context-Awareness and Interpretability of Rare Occurrences for Discovery and Formalization of Critical Failure Modes—0
Continuous Chain of Thought Enables Parallel Exploration and Reasoning—0
Controlled Natural Languages and Default Reasoning—0
COOL: A Constraint Object-Oriented Logic Programming Language and its Neural-Symbolic Compilation System—0
Counterfactual Collaborative Reasoning—0
CP-Router: An Uncertainty-Aware Router Between LLM and LRM—0
Curriculum Abductive Learning—0
d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning—0
Data Science with Vadalog: Bridging Machine Learning and Reasoning—0
DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQL—0
DBRouting: Routing End User Queries to Databases for Answerability—0
Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMs—0
Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Games—0
Deduction under Perturbed Evidence: Probing Student Simulation Capabilities of Large Language Models—0
De-fine: Decomposing and Refining Visual Programs with Auto-Feedback—0
Deliberate Reasoning for LLMs as Structure-aware Planning with Accurate World Model—0
DetectGPT-SC: Improving Detection of Text Generated by Large Language Models through Self-Consistency with Masked Predictions—0
Detection-based Intermediate Supervision for Visual Question Answering—0
Diagnosing the First-Order Logical Reasoning Ability Through LogicNLI—0
Dialogue-based Explanations for Logical Reasoning using Structured Argumentation—0
Discourse-Aware Graph Networks for Textual Logical Reasoning—0
Discrete JEPA: Learning Discrete Token Representations without Reconstruction—0
Distilling Instruction-following Abilities of Large Language Models with Task-aware Curriculum Planning—0
DMWM: Dual-Mind World Model with Long-Term Imagination—0
Does Entity Abstraction Help Generative Transformers Reason?—0
Do Large Language Models Mirror Cognitive Language Processing?—0
Do Large Language Models Truly Grasp Mathematics? An Empirical Exploration From Cognitive Psychology—0
Do Large Language Models Understand Logic or Just Mimick Context?—0
Dynamic In-Context Learning from Nearest Neighbors for Bundle Generation—0
DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks—0
Efficient but Vulnerable: Benchmarking and Defending LLM Batch Prompting Attack—0
Efficient Training and Inference of Hypergraph Reasoning Networks—0
Emergent Symbols through Binding in External Memory—0
Emotion Recognition in Conversation using Probabilistic Soft Logic—0
Empowering LLMs with Logical Reasoning: A Comprehensive Survey—0
Enhanced User Interaction in Operating Systems through Machine Learning Language Models—0
Enhancing Large Language Model Efficiencyvia Symbolic Compression: A Formal Approach Towards Interpretability—0
Enhancing Logical Reasoning in Large Language Models to Facilitate Legal Applications—0
Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library—0
Enhancing Retrieval Systems with Inference-Time Logical Reasoning—0
Enhancing Transformers for Generalizable First-Order Logical Entailment—0
Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzles—0
Evaluating Large Language Models with NeuBAROCO: Syllogistic Reasoning Ability and Human-like Biases—0
Evaluating the Potential of Leading Large Language Models in Reasoning Biology Questions—0
Evident: a Development Methodology and a Knowledge Base Topology for Data Mining, Machine Learning and General Knowledge Management—0
Explainability Is in the Mind of the Beholder: Establishing the Foundations of Explainable Artificial Intelligence—0
Explicitly Encoding Structural Symmetry is Key to Length Generalization in Arithmetic Tasks—0
Exploiting LLMs' Reasoning Capability to Infer Implicit Concepts in Legal Information Retrieval—0
Show:102550
← PrevPage 11 of 15Next →
All datasetsLingOlyBIG-bench (Formal Fallacies Syllogisms Negation)BIG-bench (Penguins In A Table)BIG-bench (Reasoning About Colored Objects)BIG-bench (Temporal Sequences)BIG-bench (Logic Grid Puzzle)BIG-bench (StrategyQA)RuWorldTreeWinograd AutomaticBIG-bench (Logical Fallacy Detection)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude OpusDelta_NoContext28.8—Unverified
2GPT-4oDelta_NoContext25.1—Unverified
3Gemini 1.5 ProDelta_NoContext23.4—Unverified
4GPT-4Delta_NoContext21.5—Unverified
5Command R+Delta_NoContext11.6—Unverified
6GPT-3.5Delta_NoContext11.2—Unverified
7Mixtral 8x7BDelta_NoContext6.4—Unverified
8Llama 3 8BDelta_NoContext4.9—Unverified
9Llama 3 70BDelta_NoContext2.9—Unverified
10Gemma 7BDelta_NoContext2.2—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, Direct)Accuracy64.8—Unverified
2PaLM 2 (few-shot, k=3, CoT)Accuracy57.2—Unverified
3OPT 66B (few-shot, k=3)Accuracy54—Unverified
4PaLM 540B (few-shot, k=3)Accuracy53.6—Unverified
5GPT-NeoX 20B (few-shot, k=3)Accuracy52.8—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy52.8—Unverified
7Chinchilla-70B (few-shot, k=5)Accuracy52.1—Unverified
8Bloomberg GPT 50B (few-shot, k=3)Accuracy50.8—Unverified
9Gopher-280B (few-shot, k=5)Accuracy50.7—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy84.9—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy65.8—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy48.7—Unverified
4PaLM 540B (few-shot, k=3)Accuracy44.5—Unverified
5Gopher-280B (few-shot, k=5)Accuracy40.6—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy40.41—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy37.67—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy33.56—Unverified
9OPT 66B (few-shot, k=3)Accuracy28.08—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy91.2—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy61.2—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy59.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy49.2—Unverified
5PaLM 540B (few-shot, k=3)Accuracy38—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy34.8—Unverified
8OPT 66B (few-shot, k=3)Accuracy31.2—Unverified
9GPT-NeoX (few-shot, k=3)Accuracy26—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy100—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy96.4—Unverified
3PaLM 540B (few-shot, k=3)Accuracy39.6—Unverified
4BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
5Chinchilla-70B (few-shot, k=5)Accuracy32—Unverified
6Bloomberg GPT (few-shot, k=3)Accuracy29.2—Unverified
7OPT 66B (few-shot, k=3)Accuracy23.6—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy21.2—Unverified
9Gopher-280B (few-shot, k=5)Accuracy19—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy44—Unverified
2PaLM-540B (few-shot, k=5)Accuracy42.4—Unverified
3PaLM-62B (few-shot, k=5)Accuracy36.5—Unverified
4Gopher-280B (few-shot, k=5)Accuracy35.1—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM-540B (few-shot, k=5)Accuracy73.9—Unverified
2Chinchilla-70B (few-shot, k=5)Accuracy68.3—Unverified
3PaLM-62B (few-shot, k=5)Accuracy65.4—Unverified
4Gopher-280B (few-shot, k=5)Accuracy61—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy 83.7—Unverified
2RuGPT-3 LargeAccuracy 40.7—Unverified
3RuGPT-3 MediumAccuracy 38—Unverified
4RuGPT-3 SmallAccuracy 34—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy87—Unverified
2RuGPT-3 SmallAccuracy57.9—Unverified
3RuGPT-3 MediumAccuracy57.2—Unverified
4RuGPT-3 LargeAccuracy55.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy72.1—Unverified
2Gopher-280B (few-shot, k=5)Accuracy58.9—Unverified