SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 101150 of 17610 papers

TitleStatusHype
Sampling from Your Language Model One Byte at a TimeCode1
ELI-Why: Evaluating the Pedagogical Utility of Language Model Explanations0
RMIT-ADM+S at the SIGIR 2025 LiveRAG ChallengeCode1
Leveraging In-Context Learning for Language Model Agents0
NTU Speechlab LLM-Based Multilingual ASR System for Interspeech MLC-SLM Challenge 20250
CFBenchmark-MM: Chinese Financial Assistant Benchmark for Multimodal Large Language Model0
Value-Free Policy Optimization via Reward PartitioningCode0
PRISM2: Unlocking Multi-Modal General Pathology AI with Clinical Dialogue0
Bi-directional Context-Enhanced Speech Large Language Models for Multilingual Conversational ASR0
Mixture of Weight-shared Heterogeneous Group Attention Experts for Dynamic Token-wise KV Optimization0
SeqPE: Transformer with Sequential Position EncodingCode1
EmoNews: A Spoken Dialogue System for Expressive News ConversationsCode0
GeoRecon: Graph-Level Representation Learning for 3D Molecules via Reconstruction-Based Pretraining0
VIS-Shepherd: Constructing Critic for LLM-based Data Visualization GenerationCode0
Qwen vs. Gemma Integration with Whisper: A Comparative Study in Multilingual SpeechLLM Systems0
Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models0
HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance0
SciSage: A Multi-Agent Framework for High-Quality Scientific Survey Generation0
Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling0
FlexRAG: A Flexible and Comprehensive Framework for Retrieval-Augmented GenerationCode3
TagRouter: Learning Route to LLMs through Tags for Open-Domain Text Generation TasksCode1
Information fusion strategy integrating pre-trained language model and contrastive learning for materials knowledge mining0
Information Suppression in Large Language Models: Auditing, Quantifying, and Characterizing Censorship in DeepSeek0
From Human to Machine Psychology: A Conceptual Framework for Understanding Well-Being in Large Language Model0
Taming Stable Diffusion for Computed Tomography Blind Super-Resolution0
Improving Large Language Model Safety with Contrastive Representation LearningCode0
Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learning0
FAA Framework: A Large Language Model-Based Approach for Credit Card Fraud Investigations0
Investigating the Potential of Large Language Model-Based Router Multi-Agent Architectures for Foundation Design Automation: A Task Classification and Expert Selection Study0
Semantic Preprocessing for LLM-based Malware Analysis0
Nowcasting the euro area with social media data0
Grounded Vision-Language Navigation for UAVs with Open-Vocabulary Goal Understanding0
MNN-LLM: A Generic Inference Engine for Fast Large Language Model Deployment on Mobile Devices0
Unsourced Adversarial CAPTCHA: A Bi-Phase Adversarial CAPTCHA Framework0
Sequential-Parallel Duality in Prefix Scannable Models0
Automated Validation of Textual Constraints Against AutomationML via LLMs and SHACLCode0
DanceChat: Large Language Model-Guided Music-to-Dance Generation0
Motion-R1: Chain-of-Thought Reasoning and Reinforcement Learning for Human Motion Generation0
Slimming Down LLMs Without Losing Their Minds0
Improving Named Entity Transcription with Contextual LLM-based Revision0
Discrete Audio Tokens: More Than a Survey!0
NeuralNexus at BEA 2025 Shared Task: Retrieval-Augmented Prompting for Mistake Identification in AI TutorsCode0
Alzheimer's Dementia Detection Using Perplexity from Paired Large Language Models0
CoLMbo: Speaker Language Model for Descriptive ProfilingCode0
You Are What You Say: Exploiting Linguistic Content for VoicePrivacy Attacks0
GigaChat Family: Efficient Russian Language Modeling Through Mixture of Experts Architecture0
Towards Multi-modal Graph Large Language Model0
Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language0
Intent Factored Generation: Unleashing the Diversity in Your Language ModelCode0
Prompt-Guided Latent Diffusion with Predictive Class Conditioning for 3D Prostate MRI Generation0
Show:102550
← PrevPage 3 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified