SOTAVerified

Logical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 301–350 of 747 papers

TitleStatusHype
Learning Syllogism with Euler Neural-Networks—0
Bayesian Entailment Hypothesis: How Brains Implement Monotonic and Non-monotonic Reasoning—0
TAR: Neural Logical Reasoning across TBox and ABox—0
Learning Reliable Logical Rules with SATNet—0
Learning Symbolic Persistent Macro-Actions for POMDP Solving Over Time—0
"Let's Argue Both Sides": Argument Generation Can Force Small Models to Utilize Previously Inaccessible Reasoning Capabilities—0
A New Fundamental Evidence of Non-Classical Structure in the Combination of Natural Concepts—0
Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understanding—0
Learning Distributed Word Representations for Natural Logic Reasoning—0
Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Games—0
Investigating and Addressing Hallucinations of LLMs in Tasks Involving Negation—0
An Explainable Fast Deep Neural Network for Emotion Recognition—0
Learning Guided Automated Reasoning: A Brief Survey—0
Axiom Learning and Belief Tracing for Transparent Decision Making in Robotics—0
Interactive Visual Assessment for Text-to-Image Generation Models—0
DB-Explore: Automated Database Exploration and Instruction Synthesis for Text-to-SQL—0
Instantiation-based Formalization of Logical Reasoning Tasks using Language Models and Logical Solvers—0
Autoregressive Image Generation Guided by Chains of Thought—0
Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models—0
Data Science with Vadalog: Bridging Machine Learning and Reasoning—0
LeafAI: query generator for clinical cohort discovery rivaling a human programmer—0
Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizing—0
Let's Reinforce Step by Step—0
Inferring User Preferences by Probabilistic Logical Reasoning over Social Networks—0
Interleaved Reasoning for Large Language Models via Reinforcement Learning—0
DBRouting: Routing End User Queries to Databases for Answerability—0
d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning—0
Reinforcement Learning from Multi-role Debates as Feedback for Bias Mitigation in LLMs—0
Is a 3D-Tokenized LLM the Key to Reliable Autonomous Driving?—0
Is ChatGPT a Good Personality Recognizer? A Preliminary Study—0
Is writing style predictive of scientific fraud?—0
Is writing style predictive of scientific fraud?—0
JAMES: Normalizing Job Titles with Multi-Aspect Graph Embeddings and Reasoning—0
Join-Chain Network: A Logical Reasoning View of the Multi-head Attention in Transformer—0
Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insights—0
Judgment of Thoughts: Courtroom of the Binary Logical Reasoning in Large Language Models—0
Deduction under Perturbed Evidence: Probing Student Simulation Capabilities of Large Language Models—0
KARGEN: Knowledge-enhanced Automated Radiology Report Generation Using Large Language Models—0
Curriculum Abductive Learning—0
KnowGraph: Knowledge-Enabled Anomaly Detection via Logical Reasoning on Graph Data—0
Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks—0
Knowledge Authoring with Factual English, Rules, and Actions—0
Automating Mathematical Proof Generation Using Large Language Model Agents and Knowledge Graphs—0
Improving Complex Reasoning over Knowledge Graph with Logic-Aware Curriculum Tuning—0
Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigm—0
Knowledge Informed Semantic Parsing for Conversational Question Answering—0
Large Language Models Might Not Care What You Are Saying: Prompt Format Beats Descriptions—0
Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoning—0
LAD-Reasoner: Tiny Multimodal Models are Good Reasoners for Logical Anomaly Detection—0
Automated Theorem Provers Help Improve Large Language Model Reasoning—0
Show:102550
← PrevPage 7 of 15Next →
All datasetsLingOlyBIG-bench (Formal Fallacies Syllogisms Negation)BIG-bench (Penguins In A Table)BIG-bench (Reasoning About Colored Objects)BIG-bench (Temporal Sequences)BIG-bench (Logic Grid Puzzle)BIG-bench (StrategyQA)RuWorldTreeWinograd AutomaticBIG-bench (Logical Fallacy Detection)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude OpusDelta_NoContext28.8—Unverified
2GPT-4oDelta_NoContext25.1—Unverified
3Gemini 1.5 ProDelta_NoContext23.4—Unverified
4GPT-4Delta_NoContext21.5—Unverified
5Command R+Delta_NoContext11.6—Unverified
6GPT-3.5Delta_NoContext11.2—Unverified
7Mixtral 8x7BDelta_NoContext6.4—Unverified
8Llama 3 8BDelta_NoContext4.9—Unverified
9Llama 3 70BDelta_NoContext2.9—Unverified
10Gemma 7BDelta_NoContext2.2—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, Direct)Accuracy64.8—Unverified
2PaLM 2 (few-shot, k=3, CoT)Accuracy57.2—Unverified
3OPT 66B (few-shot, k=3)Accuracy54—Unverified
4PaLM 540B (few-shot, k=3)Accuracy53.6—Unverified
5GPT-NeoX 20B (few-shot, k=3)Accuracy52.8—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy52.8—Unverified
7Chinchilla-70B (few-shot, k=5)Accuracy52.1—Unverified
8Bloomberg GPT 50B (few-shot, k=3)Accuracy50.8—Unverified
9Gopher-280B (few-shot, k=5)Accuracy50.7—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy84.9—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy65.8—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy48.7—Unverified
4PaLM 540B (few-shot, k=3)Accuracy44.5—Unverified
5Gopher-280B (few-shot, k=5)Accuracy40.6—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy40.41—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy37.67—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy33.56—Unverified
9OPT 66B (few-shot, k=3)Accuracy28.08—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy91.2—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy61.2—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy59.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy49.2—Unverified
5PaLM 540B (few-shot, k=3)Accuracy38—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy34.8—Unverified
8OPT 66B (few-shot, k=3)Accuracy31.2—Unverified
9GPT-NeoX (few-shot, k=3)Accuracy26—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy100—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy96.4—Unverified
3PaLM 540B (few-shot, k=3)Accuracy39.6—Unverified
4BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
5Chinchilla-70B (few-shot, k=5)Accuracy32—Unverified
6Bloomberg GPT (few-shot, k=3)Accuracy29.2—Unverified
7OPT 66B (few-shot, k=3)Accuracy23.6—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy21.2—Unverified
9Gopher-280B (few-shot, k=5)Accuracy19—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy44—Unverified
2PaLM-540B (few-shot, k=5)Accuracy42.4—Unverified
3PaLM-62B (few-shot, k=5)Accuracy36.5—Unverified
4Gopher-280B (few-shot, k=5)Accuracy35.1—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM-540B (few-shot, k=5)Accuracy73.9—Unverified
2Chinchilla-70B (few-shot, k=5)Accuracy68.3—Unverified
3PaLM-62B (few-shot, k=5)Accuracy65.4—Unverified
4Gopher-280B (few-shot, k=5)Accuracy61—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy 83.7—Unverified
2RuGPT-3 LargeAccuracy 40.7—Unverified
3RuGPT-3 MediumAccuracy 38—Unverified
4RuGPT-3 SmallAccuracy 34—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy87—Unverified
2RuGPT-3 SmallAccuracy57.9—Unverified
3RuGPT-3 MediumAccuracy57.2—Unverified
4RuGPT-3 LargeAccuracy55.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy72.1—Unverified
2Gopher-280B (few-shot, k=5)Accuracy58.9—Unverified