SOTAVerified

Logical Reasoning

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 451–500 of 747 papers

TitleStatusHype
I-Design: Personalized LLM Interior Designer—0
Language Model Guided Interpretable Video Action ReasoningCode0
Classifying Conspiratorial Narratives At Scale: False Alarms and Erroneous ConnectionsCode0
Sphere Neural-Networks for Rational Reasoning—0
Natural Language as Policies: Reasoning for Coordinate-Level Embodied Control with LLMs—0
Reasoning in Transformers - Mitigating Spurious Correlations and Reasoning Shortcuts—0
Transforming Competition into Collaboration: The Revolutionary Role of Multi-Agent Systems and Language Models in Modern OrganizationsCode0
Learning Guided Automated Reasoning: A Brief Survey—0
Fuzzy Datalog^ over Arbitrary t-Norms—0
AS-ES Learning: Towards Efficient CoT Learning in Small Models—0
Balancing Exploration and Exploitation in LLM using Soft RLLF for Enhanced Negation Understanding—0
Towards Generalist Prompting for Large Language Models by Mental Models—0
Do Large Language Models Mirror Cognitive Language Processing?—0
Enhanced User Interaction in Operating Systems through Machine Learning Language Models—0
Hint-before-Solving Prompting: Guiding LLMs to Effectively Utilize Encoded KnowledgeCode0
Federated Neural Graph Databases—0
A Neuro-Symbolic Approach to Multi-Agent RL for Interpretability and Probabilistic Decision Making—0
Science Checker Reloaded: A Bidirectional Paradigm for Transparency and Logical ReasoningCode0
Reasoning Algorithmically in Graph Neural Networks—0
Conditional Logical Message Passing Transformer for Complex Query AnsweringCode0
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models—0
Do Large Language Models Understand Logic or Just Mimick Context?—0
DiLA: Enhancing LLM Tool Learning with Differential Logic Layer—0
Puzzle Solving using Reasoning of Large Language Models: A Survey—0
Assessing the Reasoning Abilities of ChatGPT in the Context of Claim Verification—0
Navigating the Dual Facets: A Comprehensive Evaluation of Sequential Memory Editing in Large Language Models—0
Beyond LLMs: Advancing the Landscape of Complex Reasoning—0
PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs—0
Beware of Words: Evaluating the Lexical Diversity of Conversational LLMs using ChatGPT as Case Study—0
Large Language User Interfaces: Voice Interactive User Interfaces powered by LLMs—0
Symbol Correctness in Deep Neural Networks Containing Symbolic Layers—0
Large Language Models as an Indirect Reasoner: Contrapositive and Contradiction for Automated Reasoning—0
Beyond the Limits: A Survey of Techniques to Extend the Context Length in Large Language Models—0
Learning Planning-based Reasoning by Trajectories Collection and Process Reward Synthesizing—0
Revisiting Document-Level Relation Extraction with Context-Guided Link PredictionCode0
Detection-based Intermediate Supervision for Visual Question Answering—0
Dynamic In-Context Learning from Nearest Neighbors for Bundle Generation—0
Empowering Few-Shot Recommender Systems with Large Language Models -- Enhanced RepresentationsCode0
Understanding Inter-Session Intentions via Complex Logical ReasoningCode0
The Good, The Bad, and Why: Unveiling Emotions in Generative AI—0
Assessing Logical Reasoning Capabilities of Encoder-Only Transformer ModelsCode0
Assessing SATNet's Ability to Solve the Symbol Grounding Problem—0
Large Language Model Enhanced Multi-Agent Systems for 6G Communications—0
Large Language Models are Complex Table Parsers—0
Exploring the Reversal Curse and Other Deductive Logical Reasoning in BERT and GPT-Based Large Language ModelsCode0
Deciphering Digital Detectives: Understanding LLM Behaviors and Capabilities in Multi-Agent Mystery Games—0
Generation of Explanations for Logic Reasoning—0
Enhancing Logical Reasoning in Large Language Models to Facilitate Legal Applications—0
De-fine: Decomposing and Refining Visual Programs with Auto-Feedback—0
WatME: Towards Lossless Watermarking Through Lexical Redundancy—0
Show:102550
← PrevPage 10 of 15Next →
All datasetsLingOlyBIG-bench (Formal Fallacies Syllogisms Negation)BIG-bench (Penguins In A Table)BIG-bench (Reasoning About Colored Objects)BIG-bench (Temporal Sequences)BIG-bench (Logic Grid Puzzle)BIG-bench (StrategyQA)RuWorldTreeWinograd AutomaticBIG-bench (Logical Fallacy Detection)

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Claude OpusDelta_NoContext28.8—Unverified
2GPT-4oDelta_NoContext25.1—Unverified
3Gemini 1.5 ProDelta_NoContext23.4—Unverified
4GPT-4Delta_NoContext21.5—Unverified
5Command R+Delta_NoContext11.6—Unverified
6GPT-3.5Delta_NoContext11.2—Unverified
7Mixtral 8x7BDelta_NoContext6.4—Unverified
8Llama 3 8BDelta_NoContext4.9—Unverified
9Llama 3 70BDelta_NoContext2.9—Unverified
10Gemma 7BDelta_NoContext2.2—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, Direct)Accuracy64.8—Unverified
2PaLM 2 (few-shot, k=3, CoT)Accuracy57.2—Unverified
3OPT 66B (few-shot, k=3)Accuracy54—Unverified
4PaLM 540B (few-shot, k=3)Accuracy53.6—Unverified
5GPT-NeoX 20B (few-shot, k=3)Accuracy52.8—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy52.8—Unverified
7Chinchilla-70B (few-shot, k=5)Accuracy52.1—Unverified
8Bloomberg GPT 50B (few-shot, k=3)Accuracy50.8—Unverified
9Gopher-280B (few-shot, k=5)Accuracy50.7—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy84.9—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy65.8—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy48.7—Unverified
4PaLM 540B (few-shot, k=3)Accuracy44.5—Unverified
5Gopher-280B (few-shot, k=5)Accuracy40.6—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy40.41—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy37.67—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy33.56—Unverified
9OPT 66B (few-shot, k=3)Accuracy28.08—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy91.2—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy61.2—Unverified
3Chinchilla-70B (few-shot, k=5)Accuracy59.7—Unverified
4Gopher-280B (few-shot, k=5)Accuracy49.2—Unverified
5PaLM 540B (few-shot, k=3)Accuracy38—Unverified
6BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
7Bloomberg GPT (few-shot, k=3)Accuracy34.8—Unverified
8OPT 66B (few-shot, k=3)Accuracy31.2—Unverified
9GPT-NeoX (few-shot, k=3)Accuracy26—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM 2 (few-shot, k=3, CoT)Accuracy100—Unverified
2PaLM 2 (few-shot, k=3, Direct)Accuracy96.4—Unverified
3PaLM 540B (few-shot, k=3)Accuracy39.6—Unverified
4BLOOM 176B (few-shot, k=3)Accuracy36.8—Unverified
5Chinchilla-70B (few-shot, k=5)Accuracy32—Unverified
6Bloomberg GPT (few-shot, k=3)Accuracy29.2—Unverified
7OPT 66B (few-shot, k=3)Accuracy23.6—Unverified
8GPT-NeoX (few-shot, k=3)Accuracy21.2—Unverified
9Gopher-280B (few-shot, k=5)Accuracy19—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy44—Unverified
2PaLM-540B (few-shot, k=5)Accuracy42.4—Unverified
3PaLM-62B (few-shot, k=5)Accuracy36.5—Unverified
4Gopher-280B (few-shot, k=5)Accuracy35.1—Unverified
#ModelMetricClaimedVerifiedStatus
1PaLM-540B (few-shot, k=5)Accuracy73.9—Unverified
2Chinchilla-70B (few-shot, k=5)Accuracy68.3—Unverified
3PaLM-62B (few-shot, k=5)Accuracy65.4—Unverified
4Gopher-280B (few-shot, k=5)Accuracy61—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy 83.7—Unverified
2RuGPT-3 LargeAccuracy 40.7—Unverified
3RuGPT-3 MediumAccuracy 38—Unverified
4RuGPT-3 SmallAccuracy 34—Unverified
#ModelMetricClaimedVerifiedStatus
1Human benchmarkAccuracy87—Unverified
2RuGPT-3 SmallAccuracy57.9—Unverified
3RuGPT-3 MediumAccuracy57.2—Unverified
4RuGPT-3 LargeAccuracy55.5—Unverified
#ModelMetricClaimedVerifiedStatus
1Chinchilla-70B (few-shot, k=5)Accuracy72.1—Unverified
2Gopher-280B (few-shot, k=5)Accuracy58.9—Unverified