| GPT-4 Technical Report | Mar 15, 2023 | answerability predictionArithmetic Reasoning | CodeCode Available | 6 | 5 |
| DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Services | Sep 20, 2023 | Language ModellingLarge Language Model | CodeCode Available | 2 | 5 |
| LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain | Apr 2, 2024 | Argument MiningDecision Making | CodeCode Available | 1 | 5 |
| LawGPT: Knowledge-Guided Data Generation and Its Application to Legal LLM | Feb 10, 2025 | Legal Reasoning | CodeCode Available | 1 | 5 |
| A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction | Oct 18, 2023 | Information RetrievalLegal Reasoning | CodeCode Available | 1 | 5 |
| JUREX-4E: Juridical Expert-Annotated Four-Element Knowledge Base for Legal Reasoning | Feb 24, 2025 | Legal Reasoning | CodeCode Available | 1 | 5 |
| CaseGen: A Benchmark for Multi-Stage Legal Case Documents Generation | Feb 25, 2025 | Legal Reasoning | CodeCode Available | 1 | 5 |
| Developing a Pragmatic Benchmark for Assessing Korean Legal Language Understanding in Large Language Models | Oct 11, 2024 | Legal ReasoningRAG | CodeCode Available | 0 | 5 |
| Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning | Feb 8, 2025 | Legal ReasoningMultiple-choice | CodeCode Available | 0 | 5 |
| NitiBench: A Comprehensive Studies of LLM Frameworks Capabilities for Thai Legal Question Answering | Feb 15, 2025 | ChunkingInformation Retrieval | CodeCode Available | 0 | 5 |
| Parameter Efficient Fine Tuning Llama 3.1 for Answering Arabic Legal Questions: A Case Study on Jordanian Laws | Jun 2, 2025 | Language ModelingLanguage Modelling | CodeCode Available | 0 | 5 |
| Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer? | Oct 23, 2023 | Legal Reasoning | CodeCode Available | 0 | 5 |
| Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration | Oct 3, 2024 | Legal Reasoning | CodeCode Available | 0 | 5 |
| ECtHR-PCR: A Dataset for Precedent Understanding and Prior Case Retrieval in the European Court of Human Rights | Mar 31, 2024 | Legal ReasoningRetrieval | CodeCode Available | 0 | 5 |
| One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial Support | Jun 15, 2023 | BenchmarkingInformation Retrieval | CodeCode Available | 0 | 5 |
| Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning | Feb 11, 2025 | HallucinationIn-Context Learning | CodeCode Available | 0 | 5 |
| Causality and Responsibility for Formal Verification and Beyond | Aug 29, 2016 | Legal Reasoning | CodeCode Available | 0 | 5 |
| TMID: A Comprehensive Real-world Dataset for Trademark Infringement Detection in E-Commerce | Dec 8, 2023 | Legal Reasoning | CodeCode Available | 0 | 5 |
| Chain of Logic: Rule-Based Reasoning with Large Language Models | Feb 16, 2024 | Legal Reasoning | CodeCode Available | 0 | 5 |
| Software Engineering Methods For AI-Driven Deductive Legal Reasoning | Apr 15, 2024 | Formal LogicLegal Reasoning | CodeCode Available | 0 | 5 |
| LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models | Aug 20, 2023 | Legal Reasoning | CodeCode Available | 0 | 5 |
| LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning | Sep 13, 2022 | Legal Reasoning | CodeCode Available | 0 | 5 |
| Weak-to-Strong Generalization beyond Accuracy: a Pilot Study in Safety, Toxicity, and Legal Reasoning | Oct 16, 2024 | Binary ClassificationLegal Reasoning | CodeCode Available | 0 | 5 |
| Claim Extraction and Law Matching for COVID-19-related Legislation | Jun 1, 2022 | ArticlesLegal Reasoning | CodeCode Available | 0 | 5 |
| Passing the Brazilian OAB Exam: data preparation and some experiments | Dec 14, 2017 | Legal Reasoning | CodeCode Available | 0 | 5 |
| Designing Normative Theories for Ethical and Legal Reasoning: LogiKEy Framework, Methodology, and Tool Support | Mar 25, 2019 | Legal Reasoning | CodeCode Available | 0 | 5 |
| LegiLM: A Fine-Tuned Legal Language Model for Data Compliance | Sep 9, 2024 | Information RetrievalLanguage Modeling | CodeCode Available | 0 | 5 |
| LeKUBE: A Legal Knowledge Update BEnchmark | Jul 19, 2024 | Legal Reasoning | CodeCode Available | 0 | 5 |
| LLM-based HSE Compliance Assessment: Benchmark, Performance, and Advancements | May 29, 2025 | Legal Reasoning | CodeCode Available | 0 | 5 |
| Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair Use | May 4, 2025 | Knowledge GraphsLegal Reasoning | CodeCode Available | 0 | 5 |
| Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement | Oct 27, 2023 | JurisprudenceLegal Reasoning | CodeCode Available | 0 | 5 |
| KRAG Framework for Enhancing LLMs in the Legal Domain | Oct 10, 2024 | Legal ReasoningNatural Language Understanding | —Unverified | 0 | 0 |
| LAPIS: Language Model-Augmented Police Investigation System | Jul 19, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 | 0 |
| LAR-ECHR: A New Legal Argument Reasoning Task and Dataset for Cases of the European Court of Human Rights | Oct 17, 2024 | Legal ReasoningMultiple-choice | —Unverified | 0 | 0 |
| Large Language Models Acing Chartered Accountancy | Jun 26, 2025 | Legal ReasoningRetrieval-augmented Generation | —Unverified | 0 | 0 |
| Large Language Models in Cryptocurrency Securities Cases: Can a GPT Model Meaningfully Assist Lawyers? | Aug 11, 2023 | Decision MakingLegal Reasoning | —Unverified | 0 | 0 |
| Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humans | Sep 14, 2022 | Legal ReasoningPhilosophy | —Unverified | 0 | 0 |
| Law to Binary Tree -- An Formal Interpretation of Legal Natural Language | Dec 16, 2022 | Decision MakingLegal Reasoning | —Unverified | 0 | 0 |
| An Argumentation-Based Legal Reasoning Approach for DL-Ontology | Sep 7, 2022 | Autonomous VehiclesLegal Reasoning | —Unverified | 0 | 0 |
| Legal Evalutions and Challenges of Large Language Models | Nov 15, 2024 | Legal Reasoning | —Unverified | 0 | 0 |
| Legal Judgment Prediction (LJP) Amid the Advent of Autonomous AI Legal Reasoning | Sep 29, 2020 | Legal Reasoning | —Unverified | 0 | 0 |
| Legal Prompting: Teaching a Language Model to Think Like a Lawyer | Dec 2, 2022 | Common Sense ReasoningLanguage Modeling | —Unverified | 0 | 0 |
| Legal Sentiment Analysis and Opinion Mining (LSAOM): Assimilating Advances in Autonomous AI Legal Reasoning | Oct 2, 2020 | Legal ReasoningOpinion Mining | —Unverified | 0 | 0 |
| LEXam: Benchmarking Legal Reasoning on 340 Law Exams | May 19, 2025 | BenchmarkingLegal Reasoning | —Unverified | 0 | 0 |
| Logical Lease Litigation: Prolog and LLMs for Rental Law Compliance in New York | Feb 13, 2025 | Legal ReasoningLogical Reasoning | —Unverified | 0 | 0 |
| Multidimensionality of Legal Singularity: Parametric Analysis and the Autonomous Levels of AI Legal Reasoning | Aug 24, 2020 | Legal Reasoning | —Unverified | 0 | 0 |
| New Algebraic Normative Theories for Ethical and Legal Reasoning in the LogiKEy Framework | Jul 25, 2021 | Legal Reasoning | —Unverified | 0 | 0 |
| Non-Determinism and the Lawlessness of Machine Learning Code | Jun 23, 2022 | Legal Reasoning | —Unverified | 0 | 0 |
| PARAMANU-AYN: Pretrain from scratch or Continual Pretraining of LLMs for Legal Domain Adaptation? | Mar 20, 2024 | Abstractive Text SummarizationContinual Pretraining | —Unverified | 0 | 0 |
| Proceedings First Workshop on Causal Reasoning for Embedded and safety-critical Systems Technologies | Aug 26, 2016 | Fault localizationLegal Reasoning | —Unverified | 0 | 0 |
