SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 16011650 of 17610 papers

TitleStatusHype
MMRC: A Large-Scale Benchmark for Understanding Multimodal Large Language Model in Real-World Conversation0
Aligning Sentence Simplification with ESL Learner's Proficiency for Language AcquisitionCode0
GeoDANO: Geometric VLM with Domain Agnostic Vision Encoder0
M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment AnalysisCode1
Personality Structured Interview for Large Language Model Simulation in Personality Research0
Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation?Code1
RIDE: Enhancing Large Language Model Alignment through Restyled In-Context Learning Demonstration ExemplarsCode0
TimeCAP: Learning to Contextualize, Augment, and Predict Time Series Events with Large Language Model Agents0
video-SALMONN-o1: Reasoning-enhanced Audio-visual Large Language ModelCode1
ReviewEval: An Evaluation Framework for AI-Generated Reviews0
APB: Accelerating Distributed Long-Context Inference by Passing Compressed Context Blocks across GPUsCode1
Plant in Cupboard, Orange on Rably, Inat Aphone. Benchmarking Incremental Learning of Situation and Language Model using a Text-Simulated Situated Environment0
Accuracy Assessment of OpenAlex and Clarivate Scholar ID with an LLM-Assisted Benchmark0
Learning to Keep a Promise: Scaling Language Model Decoding Parallelism with Learned Asynchronous Decoding0
GLTW: Joint Improved Graph Transformer and LLM via Three-Word Language for Knowledge Graph Completion0
Competing LLM Agents in a Non-Cooperative Game of Opinion Polarisation0
Fast or Better? Balancing Accuracy and Cost in Retrieval-Augmented Generation with Flexible User ControlCode0
DELMAN: Dynamic Defense Against Large Language Model Jailbreaking with Model Editing0
DuplexMamba: Enhancing Real-time Speech Conversations with Duplex and Streaming CapabilitiesCode1
LogiDynamics: Unraveling the Dynamics of Logical Inference in Large Language Model Reasoning0
AdaGC: Improving Training Stability for Large Language Model Pretraining0
Towards Achieving Concept Completeness for Textual Concept Bottleneck Models0
MMUnlearner: Reformulating Multimodal Machine Unlearning in the Era of Multimodal Large Language ModelsCode1
Knowledge Graph-Driven Retrieval-Augmented Generation: Integrating Deepseek-R1 with Weaviate for Advanced Chatbot ApplicationsCode1
Improved Unbiased Watermark for Large Language Models0
Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification0
RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM GenerationCode2
Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language ModelsCode1
Leveraging Multimodal-LLMs Assisted by Instance Segmentation for Intelligent Traffic Monitoring0
Hierarchical Expert Prompt for Large-Language-Model: An Approach Defeat Elite AI in TextStarCraft II for the First TimeCode2
SCALE: Towards Collaborative Content Analysis in Social Science with Large Language Model Agents and Human InterventionCode0
G-Safeguard: A Topology-Guided Security Lens and Treatment on LLM-based Multi-agent SystemsCode0
FELLE: Autoregressive Speech Synthesis with Token-Wise Coarse-to-Fine Flow Matching0
Unveiling Environmental Impacts of Large Language Model Serving: A Functional Unit ViewCode0
Hallucinations are inevitable but can be made statistically negligible. The "innate" inevitability of hallucinations cannot explain practical LLM issues0
PCGRLLM: Large Language Model-Driven Reward Design for Procedural Content Generation Reinforcement Learning0
K-Edit: Language Model Editing with Contextual Knowledge Awareness0
Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language ModelCode1
Distraction is All You Need for Multimodal Large Language Model Jailbreaking0
Hierarchically-Structured Open-Vocabulary Indoor Scene Synthesis with Pre-trained Large Language Model0
LoRE-Merging: Exploring Low-Rank Estimation For Large Language Model Merging0
BabyLM Turns 3: Call for papers for the 2025 BabyLM workshop0
HybriDNA: A Hybrid Transformer-Mamba2 Long-Range DNA Language Model0
Order-agnostic Identifier for Large Language Model-based Generative Recommendation0
An Empirical Analysis of Uncertainty in Large Language Model EvaluationsCode0
Hybrid Offline-online Scheduling Method for Large Language Model Inference Optimization0
A Survey on LLM-powered Agents for Recommender Systems0
HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge AdaptationCode5
MixMin: Finding Data Mixtures via Convex Minimization0
MTLM: Incorporating Bidirectional Text Information to Enhance Language Model Training in Speech Recognition Systems0
Show:102550
← PrevPage 33 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified