SOTAVerified

Legal Reasoning

Papers

Showing 7692 of 92 papers

TitleStatusHype
ECtHR-PCR: A Dataset for Precedent Understanding and Prior Case Retrieval in the European Court of Human RightsCode0
Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal ReasoningCode0
LeKUBE: A Legal Knowledge Update BEnchmarkCode0
One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial SupportCode0
Software Engineering Methods For AI-Driven Deductive Legal ReasoningCode0
LLM-based HSE Compliance Assessment: Benchmark, Performance, and AdvancementsCode0
Parameter Efficient Fine Tuning Llama 3.1 for Answering Arabic Legal Questions: A Case Study on Jordanian LawsCode0
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language ModelsCode0
LegalBench: Prototyping a Collaborative Benchmark for Legal ReasoningCode0
Causality and Responsibility for Formal Verification and BeyondCode0
Modeling Legal Reasoning: LM Annotation at the Edge of Human AgreementCode0
Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent CollaborationCode0
Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair UseCode0
Passing the Brazilian OAB Exam: data preparation and some experimentsCode0
Investigating the Shortcomings of LLMs in Step-by-Step Legal ReasoningCode0
Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer?Code0
Weak-to-Strong Generalization beyond Accuracy: a Pilot Study in Safety, Toxicity, and Legal ReasoningCode0
Show:102550
← PrevPage 4 of 4Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GPT-4Balanced Accuracy82.9Unverified
2GPT-3.5Balanced Accuracy60.9Unverified
3Claude-1Balanced Accuracy58.1Unverified
#ModelMetricClaimedVerifiedStatus
1GPT-4Balanced Accuracy59.2Unverified