SOTAVerified

Logical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 701–747 of 747 papers

TitleStatusHype
Neural Logic Networks—0
MMM: Multi-stage Multi-task Learning for Multi-choice Reading ComprehensionCode0
Graph Neural Reasoning May Fail in Certifying Boolean Unsatisfiability—0
Graph Neural Networks for Reasoning 2-Quantified Boolean Formulas—0
Non-monotonic Logical Reasoning Guiding Deep Learning for Explainable Visual Question Answering—0
Teaching Pretrained Models with Commonsense Reasoning: A Preliminary KB-Based Approach—0
Logic and the 2-Simplicial Transformer—0
Towards a Theory of Intentions for Human-Robot Collaboration—0
Semantic RL with Action Grammars: Data-Efficient Learning of Hierarchical Task AbstractionsCode0
SATNet: Bridging deep learning and logical reasoning using a differentiable satisfiability solverCode0
Controlled Natural Languages and Default Reasoning—0
Declarative Question Answering over Knowledge Bases containing Natural Language Text with Answer Set ProgrammingCode0
How to Make a BLT Sandwich? Learning to Reason towards Understanding Web Instructional Videos—0
Compositional Attention Networks for Interpretability in Natural Language Question Answering—0
Ontology Reasoning with Deep Neural NetworksCode0
Argumentation Synthesis following Rhetorical Strategies—0
Modeling Human Decision-making: An Overview of the Brussels Quantum Approach—0
Data Science with Vadalog: Bridging Machine Learning and Reasoning—0
Neural Tensor Networks with Diagonal Slice Matrices—0
DeepLogic: Towards End-to-End Differentiable Logical ReasoningCode0
Consistent CCG Parsing over Multiple Sentences for Improved Logical Reasoning—0
First Experiments with a Flexible Infrastructure for Normative Reasoning—0
A Dataset and Architecture for Visual Reasoning with a Working MemoryCode0
GOTaxon: Representing the evolution of biological functions in the Gene OntologyCode0
A New Algorithmic Decision for Categorical Syllogisms via Caroll's Diagrams—0
A Theoretical Solution of the Mind-Body Problem: An Operationalized Proof that no Purely Physical System Can Exhibit all the Properties of Human Consciousness—0
Is writing style predictive of scientific fraud?—0
TensorLog: Deep Learning Meets Probabilistic DBs—0
Is writing style predictive of scientific fraud?—0
Towards Better Response Times and Higher-Quality Queries in Interactive Knowledge Base Debugging—0
Compositional Distributional Cognition—0
Chains of Reasoning over Entities, Relations, and Text using Recurrent Neural NetworksCode0
Neural Networks and Continuous Time—0
Mapping Ontologies Using Ontologies: Cross-lingual Semantic Role Information Transfer—0
Reasoning in Vector Space: An Exploratory Study of Question Answering—0
Object-Oriented Dynamic Networks—0
Mixed Logical and Probabilistic Reasoning for Planning and Explanation Generation in Robotics—0
Towards Ideal Semantics for Analyzing Stream Reasoning—0
A New Fundamental Evidence of Non-Classical Structure in the Combination of Natural Concepts—0
The RatioLog Project: Rational Extensions of Logical Reasoning—0
Quantum Structure of Negation and Conjunction in Human Thought—0
Quantum Structure in Cognition and the Foundations of Human Reasoning—0
Inferring User Preferences by Probabilistic Logical Reasoning over Social Networks—0
Learning Distributed Word Representations for Natural Logic Reasoning—0
New Directions in Vector Space Models of Meaning—0
Can recursive neural tensor networks learn logical reasoning?Code0
Lp : A Logic for Statistical Information—0
Show:102550
← PrevPage 15 of 15Next →
All datasetsLingOlyBIG-bench (Formal Fallacies Syllogisms Negation)BIG-bench (Penguins In A Table)BIG-bench (Reasoning About Colored Objects)BIG-bench (Temporal Sequences)BIG-bench (Logic Grid Puzzle)BIG-bench (StrategyQA)RuWorldTreeWinograd AutomaticBIG-bench (Logical Fallacy Detection)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude OpusDelta_NoContext28.8—Unverified
2GPT-4oDelta_NoContext25.1—Unverified
3Gemini 1.5 ProDelta_NoContext23.4—Unverified
4GPT-4Delta_NoContext21.5—Unverified
5Command R+Delta_NoContext11.6—Unverified
6GPT-3.5Delta_NoContext11.2—Unverified
7Mixtral 8x7BDelta_NoContext6.4—Unverified
8Llama 3 8BDelta_NoContext4.9—Unverified
9Llama 3 70BDelta_NoContext2.9—Unverified
10Gemma 7BDelta_NoContext2.2—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, Direct)Accuracy64.8—Unverified
2PaLM 2 (few-shot, k=3, CoT)Accuracy57.2—Unverified
3OPT 66B (few-shot, k=3)Accuracy54—Unverified
4PaLM 540B (few-shot, k=3)Accuracy53.6—Unverified
5GPT-NeoX 20B (few-shot, k=3)Accuracy52.8—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy52.8—Unverified
7Chinchilla-70B (few-shot, k=5)Accuracy52.1—Unverified
8Bloomberg GPT 50B (few-shot, k=3)Accuracy50.8—Unverified
9Gopher-280B (few-shot, k=5)Accuracy50.7—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy84.9—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy65.8—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy48.7—Unverified
4PaLM 540B (few-shot, k=3)Accuracy44.5—Unverified
5Gopher-280B (few-shot, k=5)Accuracy40.6—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy40.41—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy37.67—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy33.56—Unverified
9OPT 66B (few-shot, k=3)Accuracy28.08—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy91.2—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy61.2—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy59.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy49.2—Unverified
5PaLM 540B (few-shot, k=3)Accuracy38—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy34.8—Unverified
8OPT 66B (few-shot, k=3)Accuracy31.2—Unverified
9GPT-NeoX (few-shot, k=3)Accuracy26—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy100—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy96.4—Unverified
3PaLM 540B (few-shot, k=3)Accuracy39.6—Unverified
4BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
5Chinchilla-70B (few-shot, k=5)Accuracy32—Unverified
6Bloomberg GPT (few-shot, k=3)Accuracy29.2—Unverified
7OPT 66B (few-shot, k=3)Accuracy23.6—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy21.2—Unverified
9Gopher-280B (few-shot, k=5)Accuracy19—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy44—Unverified
2PaLM-540B (few-shot, k=5)Accuracy42.4—Unverified
3PaLM-62B (few-shot, k=5)Accuracy36.5—Unverified
4Gopher-280B (few-shot, k=5)Accuracy35.1—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM-540B (few-shot, k=5)Accuracy73.9—Unverified
2Chinchilla-70B (few-shot, k=5)Accuracy68.3—Unverified
3PaLM-62B (few-shot, k=5)Accuracy65.4—Unverified
4Gopher-280B (few-shot, k=5)Accuracy61—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy 83.7—Unverified
2RuGPT-3 LargeAccuracy 40.7—Unverified
3RuGPT-3 MediumAccuracy 38—Unverified
4RuGPT-3 SmallAccuracy 34—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy87—Unverified
2RuGPT-3 SmallAccuracy57.9—Unverified
3RuGPT-3 MediumAccuracy57.2—Unverified
4RuGPT-3 LargeAccuracy55.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy72.1—Unverified
2Gopher-280B (few-shot, k=5)Accuracy58.9—Unverified