SOTAVerified

Logical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 451–500 of 747 papers

TitleStatusHype
A Simple Generative Model of Logical Reasoning and Statistical Learning—0
A (Simplified) Supreme Being Necessarily Exists, says the Computer: Computationally Explored Variants of Gödel's Ontological Argument—0
Assessing SATNet's Ability to Solve the Symbol Grounding Problem—0
Assessing Step-by-Step Reasoning against Lexical Negation: A Case Study on Syllogism—0
Assessing the Reasoning Abilities of ChatGPT in the Context of Claim Verification—0
A Study on Neuro-Symbolic Artificial Intelligence: Healthcare Perspectives—0
A Survey of Knowledge Enhanced Pre-trained Models—0
A Survey on State-of-the-art Techniques for Knowledge Graphs Construction and Challenges ahead—0
A Synergistic Approach In Network Intrusion Detection By Neurosymbolic AI—0
A Systematic Assessment of OpenAI o1-Preview for Higher Order Thinking in Education—0
A Theoretical Solution of the Mind-Body Problem: An Operationalized Proof that no Purely Physical System Can Exhibit all the Properties of Human Consciousness—0
Attribution-Scores and Causal Counterfactuals as Explanations in Artificial Intelligence—0
Automated scholarly paper review: Concepts, technologies, and challenges—0
Automated Theorem Provers Help Improve Large Language Model Reasoning—0
Automating Mathematical Proof Generation Using Large Language Model Agents and Knowledge Graphs—0
Autoregressive Image Generation Guided by Chains of Thought—0
Axiom Learning and Belief Tracing for Transparent Decision Making in Robotics—0
Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understanding—0
Bayesian Entailment Hypothesis: How Brains Implement Monotonic and Non-monotonic Reasoning—0
Bayes Meets Entailment and Prediction: Commonsense Reasoning with Non-monotonicity, Paraconsistency and Predictive Accuracy—0
Beware of Words: Evaluating the Lexical Diversity of Conversational LLMs using ChatGPT as Case Study—0
Beyond LLMs: Advancing the Landscape of Complex Reasoning—0
Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models—0
Bi-Chainer: Automated Large Language Models Reasoning with Bidirectional Chaining—0
BloombergGPT: A Large Language Model for Finance—0
Boosting Deductive Reasoning with Step Signals In RLHF—0
Boosting Logical Reasoning in Large Language Models through a New Framework: The Graph of Thought—0
Brainstorming Brings Power to Large Language Models of Knowledge Reasoning—0
Bridging Technology and Humanities: Evaluating the Impact of Large Language Models on Social Sciences Research with DeepSeek-R1—0
BTPK-based interpretable method for NER tasks based on Talmudic Public Announcement Logic—0
Building Trustworthy AI: Transparent AI Systems via Large Language Models, Ontologies, and Logical Reasoning (TranspNet)—0
Can BERT Conduct Logical Reasoning? On the Difficulty of Learning to Reason from Data—0
Can Large Language Models Reason? A Characterization via 3-SAT—0
Can OpenAI o1 outperform humans in higher-order cognitive thinking?—0
Cantor: Inspiring Multimodal Chain-of-Thought of MLLM—0
Can Transformers Reason Logically? A Study in SAT Solving—0
CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues—0
CAPO: Reinforcing Consistent Reasoning in Medical Decision-Making—0
Categorical Syllogisms Revisited: A Review of the Logical Reasoning Abilities of LLMs for Analyzing Categorical Syllogism—0
CausalR: Causal Reasoning over Natural Language Rulebases—0
CauseJudger: Identifying the Cause with LLMs for Abductive Logical Reasoning—0
ChatABL: Abductive Learning via Natural Language Interaction with ChatGPT—0
ChatGPT is a Remarkable Tool -- For Experts—0
City-LEO: Toward Transparent City Management Using LLM with End-to-End Optimization—0
CLR-Fact: Evaluating the Complex Logical Reasoning Capability of Large Language Models over Factual Knowledge—0
CodePMP: Scalable Preference Model Pretraining for Large Language Model Reasoning—0
Cognitive Argumentation and the Suppression Task—0
Combining Commonsense Reasoning and Knowledge Acquisition to Guide Deep Learning in Robotics—0
Combining Domain-Specific Models and LLMs for Automated Disease Phenotyping from Survey Data—0
Compositional Attention Networks for Interpretability in Natural Language Question Answering—0
Show:102550
← PrevPage 10 of 15Next →
All datasetsLingOlyBIG-bench (Formal Fallacies Syllogisms Negation)BIG-bench (Penguins In A Table)BIG-bench (Reasoning About Colored Objects)BIG-bench (Temporal Sequences)BIG-bench (Logic Grid Puzzle)BIG-bench (StrategyQA)RuWorldTreeWinograd AutomaticBIG-bench (Logical Fallacy Detection)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude OpusDelta_NoContext28.8—Unverified
2GPT-4oDelta_NoContext25.1—Unverified
3Gemini 1.5 ProDelta_NoContext23.4—Unverified
4GPT-4Delta_NoContext21.5—Unverified
5Command R+Delta_NoContext11.6—Unverified
6GPT-3.5Delta_NoContext11.2—Unverified
7Mixtral 8x7BDelta_NoContext6.4—Unverified
8Llama 3 8BDelta_NoContext4.9—Unverified
9Llama 3 70BDelta_NoContext2.9—Unverified
10Gemma 7BDelta_NoContext2.2—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, Direct)Accuracy64.8—Unverified
2PaLM 2 (few-shot, k=3, CoT)Accuracy57.2—Unverified
3OPT 66B (few-shot, k=3)Accuracy54—Unverified
4PaLM 540B (few-shot, k=3)Accuracy53.6—Unverified
5GPT-NeoX 20B (few-shot, k=3)Accuracy52.8—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy52.8—Unverified
7Chinchilla-70B (few-shot, k=5)Accuracy52.1—Unverified
8Bloomberg GPT 50B (few-shot, k=3)Accuracy50.8—Unverified
9Gopher-280B (few-shot, k=5)Accuracy50.7—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy84.9—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy65.8—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy48.7—Unverified
4PaLM 540B (few-shot, k=3)Accuracy44.5—Unverified
5Gopher-280B (few-shot, k=5)Accuracy40.6—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy40.41—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy37.67—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy33.56—Unverified
9OPT 66B (few-shot, k=3)Accuracy28.08—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy91.2—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy61.2—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy59.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy49.2—Unverified
5PaLM 540B (few-shot, k=3)Accuracy38—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy34.8—Unverified
8OPT 66B (few-shot, k=3)Accuracy31.2—Unverified
9GPT-NeoX (few-shot, k=3)Accuracy26—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy100—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy96.4—Unverified
3PaLM 540B (few-shot, k=3)Accuracy39.6—Unverified
4BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
5Chinchilla-70B (few-shot, k=5)Accuracy32—Unverified
6Bloomberg GPT (few-shot, k=3)Accuracy29.2—Unverified
7OPT 66B (few-shot, k=3)Accuracy23.6—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy21.2—Unverified
9Gopher-280B (few-shot, k=5)Accuracy19—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy44—Unverified
2PaLM-540B (few-shot, k=5)Accuracy42.4—Unverified
3PaLM-62B (few-shot, k=5)Accuracy36.5—Unverified
4Gopher-280B (few-shot, k=5)Accuracy35.1—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM-540B (few-shot, k=5)Accuracy73.9—Unverified
2Chinchilla-70B (few-shot, k=5)Accuracy68.3—Unverified
3PaLM-62B (few-shot, k=5)Accuracy65.4—Unverified
4Gopher-280B (few-shot, k=5)Accuracy61—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy 83.7—Unverified
2RuGPT-3 LargeAccuracy 40.7—Unverified
3RuGPT-3 MediumAccuracy 38—Unverified
4RuGPT-3 SmallAccuracy 34—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy87—Unverified
2RuGPT-3 SmallAccuracy57.9—Unverified
3RuGPT-3 MediumAccuracy57.2—Unverified
4RuGPT-3 LargeAccuracy55.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy72.1—Unverified
2Gopher-280B (few-shot, k=5)Accuracy58.9—Unverified