| GPT-4 Technical Report | Mar 15, 2023 | answerability predictionArithmetic Reasoning | CodeCode Available | 6 |
| DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Services | Sep 20, 2023 | Language ModellingLarge Language Model | CodeCode Available | 2 |
| CaseGen: A Benchmark for Multi-Stage Legal Case Documents Generation | Feb 25, 2025 | Legal Reasoning | CodeCode Available | 1 |
| JUREX-4E: Juridical Expert-Annotated Four-Element Knowledge Base for Legal Reasoning | Feb 24, 2025 | Legal Reasoning | CodeCode Available | 1 |
| LawGPT: Knowledge-Guided Data Generation and Its Application to Legal LLM | Feb 10, 2025 | Legal Reasoning | CodeCode Available | 1 |
| LawInstruct: A Resource for Studying Language Model Adaptation to the Legal Domain | Apr 2, 2024 | Argument MiningDecision Making | CodeCode Available | 1 |
| A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction | Oct 18, 2023 | Information RetrievalLegal Reasoning | CodeCode Available | 1 |
| IndianBailJudgments-1200: A Multi-Attribute Dataset for Legal NLP on Indian Bail Orders | Jul 3, 2025 | AttributeFairness | —Unverified | 0 |
| Large Language Models Acing Chartered Accountancy | Jun 26, 2025 | Legal ReasoningRetrieval-augmented Generation | —Unverified | 0 |
| CHANCERY: Evaluating Corporate Governance Reasoning Capabilities in Language Models | Jun 5, 2025 | Binary ClassificationLegal Reasoning | —Unverified | 0 |
| When Fairness Isn't Statistical: The Limits of Machine Learning in Evaluating Legal Reasoning | Jun 4, 2025 | ClusteringFairness | —Unverified | 0 |
| Parameter Efficient Fine Tuning Llama 3.1 for Answering Arabic Legal Questions: A Case Study on Jordanian Laws | Jun 2, 2025 | Language ModelingLanguage Modelling | CodeCode Available | 0 |
| LLM-based HSE Compliance Assessment: Benchmark, Performance, and Advancements | May 29, 2025 | Legal Reasoning | CodeCode Available | 0 |
| LEXam: Benchmarking Legal Reasoning on 340 Law Exams | May 19, 2025 | BenchmarkingLegal Reasoning | —Unverified | 0 |
| Incorporating Legal Structure in Retrieval-Augmented Generation: A Case Study on Copyright Fair Use | May 4, 2025 | Knowledge GraphsLegal Reasoning | CodeCode Available | 0 |
| SynLexLM: Scaling Legal LLMs with Synthetic Data and Curriculum Learning | Apr 26, 2025 | Data AugmentationLegal Reasoning | —Unverified | 0 |
| Engineering the Law-Machine Learning Translation Problem: Developing Legally Aligned Models | Apr 23, 2025 | Legal Reasoning | —Unverified | 0 |
| Continual Pre-Training is (not) What You Need in Domain Adaption | Apr 18, 2025 | Decision MakingDomain Adaptation | —Unverified | 0 |
| KFinEval-Pilot: A Comprehensive Benchmark Suite for Korean Financial Language Understanding | Apr 17, 2025 | DiagnosticLegal Reasoning | —Unverified | 0 |
| An Explicit Syllogistic Legal Reasoning Framework for Large Language Models | Apr 5, 2025 | Legal Reasoning | —Unverified | 0 |
| Evaluating Test-Time Scaling LLMs for Legal Reasoning: OpenAI o1, DeepSeek-R1, and Beyond | Mar 20, 2025 | Legal Reasoning | —Unverified | 0 |
| Adaptively profiling models with task elicitation | Mar 3, 2025 | HallucinationLanguage Modeling | —Unverified | 0 |
| Towards Robust Legal Reasoning: Harnessing Logical LLMs in Law | Feb 24, 2025 | Legal ReasoningNatural Language Understanding | —Unverified | 0 |
| NitiBench: A Comprehensive Studies of LLM Frameworks Capabilities for Thai Legal Question Answering | Feb 15, 2025 | ChunkingInformation Retrieval | CodeCode Available | 0 |
| Logical Lease Litigation: Prolog and LLMs for Rental Law Compliance in New York | Feb 13, 2025 | Legal ReasoningLogical Reasoning | —Unverified | 0 |
| Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning | Feb 11, 2025 | HallucinationIn-Context Learning | CodeCode Available | 0 |
| Investigating the Shortcomings of LLMs in Step-by-Step Legal Reasoning | Feb 8, 2025 | Legal ReasoningMultiple-choice | CodeCode Available | 0 |
| Artificial Intelligence and Legal Analysis: Implications for Legal Education and the Profession | Feb 4, 2025 | Legal Reasoning | —Unverified | 0 |
| Domaino1s: Guiding LLM Reasoning for Explainable Answers in High-Stakes Domains | Jan 24, 2025 | 2kLegal Reasoning | —Unverified | 0 |
| Legal Evalutions and Challenges of Large Language Models | Nov 15, 2024 | Legal Reasoning | —Unverified | 0 |
| LAR-ECHR: A New Legal Argument Reasoning Task and Dataset for Cases of the European Court of Human Rights | Oct 17, 2024 | Legal ReasoningMultiple-choice | —Unverified | 0 |
| Weak-to-Strong Generalization beyond Accuracy: a Pilot Study in Safety, Toxicity, and Legal Reasoning | Oct 16, 2024 | Binary ClassificationLegal Reasoning | CodeCode Available | 0 |
| Developing a Pragmatic Benchmark for Assessing Korean Legal Language Understanding in Large Language Models | Oct 11, 2024 | Legal ReasoningRAG | CodeCode Available | 0 |
| Using LLMs to Discover Legal Factors | Oct 10, 2024 | Legal Reasoning | —Unverified | 0 |
| KRAG Framework for Enhancing LLMs in the Legal Domain | Oct 10, 2024 | Legal ReasoningNatural Language Understanding | —Unverified | 0 |
| Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration | Oct 3, 2024 | Legal Reasoning | CodeCode Available | 0 |
| LegiLM: A Fine-Tuned Legal Language Model for Data Compliance | Sep 9, 2024 | Information RetrievalLanguage Modeling | CodeCode Available | 0 |
| LAPIS: Language Model-Augmented Police Investigation System | Jul 19, 2024 | Language ModelingLanguage Modelling | —Unverified | 0 |
| LeKUBE: A Legal Knowledge Update BEnchmark | Jul 19, 2024 | Legal Reasoning | CodeCode Available | 0 |
| Formalising Anti-Discrimination Law in Automated Decision Systems | Jun 29, 2024 | FairnessLegal Reasoning | —Unverified | 0 |
| Bridging Law and Data: Augmenting Reasoning via a Semi-Structured Dataset with IRAC methodology | Jun 19, 2024 | Legal ReasoningRetrieval | —Unverified | 0 |
| Towards Supporting Legal Argumentation with NLP: Is More Data Really All You Need? | Jun 16, 2024 | AllLegal Reasoning | —Unverified | 0 |
| Explainable machine learning multi-label classification of Spanish legal judgements | May 27, 2024 | ClassificationJurisprudence | —Unverified | 0 |
| Software Engineering Methods For AI-Driven Deductive Legal Reasoning | Apr 15, 2024 | Formal LogicLegal Reasoning | CodeCode Available | 0 |
| ECtHR-PCR: A Dataset for Precedent Understanding and Prior Case Retrieval in the European Court of Human Rights | Mar 31, 2024 | Legal ReasoningRetrieval | CodeCode Available | 0 |
| PARAMANU-AYN: Pretrain from scratch or Continual Pretraining of LLMs for Legal Domain Adaptation? | Mar 20, 2024 | Abstractive Text SummarizationContinual Pretraining | —Unverified | 0 |
| Chain of Logic: Rule-Based Reasoning with Large Language Models | Feb 16, 2024 | Legal Reasoning | CodeCode Available | 0 |
| Advancing Legal Reasoning: The Integration of AI to Navigate Complexities and Biases in Global Jurisprudence with Semi-Automated Arbitration Processes (SAAPs) | Feb 6, 2024 | FairnessJurisprudence | —Unverified | 0 |
| Aalap: AI Assistant for Legal & Paralegal Functions in India | Jan 30, 2024 | Legal Reasoning | —Unverified | 0 |
| Automated legal reasoning with discretion to act using s(LAW) | Jan 25, 2024 | BenchmarkingLegal Reasoning | —Unverified | 0 |
