SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 201250 of 17610 papers

TitleStatusHype
Voice Impression Control in Zero-Shot TTS0
Customizing Speech Recognition Model with Large Language Model Feedback0
Zeroth-Order Optimization Finds Flat Minima0
Accelerated Test-Time Scaling with Model-Free Speculative Sampling0
ConECT Dataset: Overcoming Data Scarcity in Context-Aware E-Commerce MT0
MesaNet: Sequence Modeling by Locally Optimal Test-Time TrainingCode0
HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model TrainingCode0
E-bike agents: Large Language Model-Driven E-Bike Accident Analysis and Severity Prediction0
Improving Low-Resource Morphological Inflection via Self-Supervised Objectives0
Unleashing Hour-Scale Video Training for Long Video-Language Understanding0
Hierarchical Language Models for Semantic Navigation and Manipulation in an Aerial-Ground Robotic System0
The NTNU System at the S&I Challenge 2025 SLA Open Track0
LESS: Large Language Model Enhanced Semi-Supervised Learning for Speech Foundational Models0
OpenMaskDINO3D : Reasoning 3D Segmentation via Large Language ModelCode1
HoliSafe: Holistic Safety Benchmarking and Modeling with Safety Meta Token for Vision-Language Model0
Clustering and Median Aggregation Improve Differentially Private Inference0
Exp4Fuse: A Rank Fusion Framework for Enhanced Sparse Retrieval using Large Language Model-based Query ExpansionCode0
Handle-based Mesh Deformation Guided By Vision Language Model0
Robust Few-Shot Vision-Language Model Adaptation0
Sparse Autoencoders, Again?0
Go-Browse: Training Web Agents with Structured Exploration0
Debate, Reflect, and Distill: Multi-Agent Feedback with Tree-Structured Preference Optimization for Efficient Language Model Enhancement0
Phi-Omni-ST: A multimodal language model for direct speech-to-speech translation0
Evaluating Large Language Model Capabilities in Assessing Spatial Econometrics Research0
POSS: Position Specialist Generates Better Draft for Speculative DecodingCode1
EuroLLM-9B: Technical Report0
MedAgentGym: Training LLM Agents for Code-Based Medical Reasoning at Scale0
MELABenchv1: Benchmarking Large Language Models against Smaller Fine-Tuned Models for Low-Resource Maltese NLP0
Rectified Sparse Attention0
A Statistical Physics of Language Model Reasoning0
Towards Efficient Speech-Text Jointly Decoding within One Speech Language Model0
KOALA++: Efficient Kalman-Based Optimization of Neural Networks with Gradient-Covariance Products0
"Don't Do That!": Guiding Embodied Systems through Large Language Model-based Constraint Generation0
A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions0
LaF-GRPO: In-Situ Navigation Instruction Generation for the Visually Impaired via GRPO with LLM-as-Follower RewardCode0
Think Like a Person Before Responding: A Multi-Faceted Evaluation of Persona-Guided LLMs for Countering HateCode0
Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems0
Evaluating Apple Intelligence's Writing Tools for Privacy Against Large Language Model-Based Inference Attacks: Insights from Early Datasets0
MASTER: Enhancing Large Language Model via Multi-Agent Simulated Teaching0
EALG: Evolutionary Adversarial Generation of Language Model-Guided Generators for Combinatorial Optimization0
IMPARA-GED: Grammatical Error Detection is Boosting Reference-free Grammatical Error Quality Estimator0
Trajectory Prediction Meets Large Language Models: A SurveyCode5
A Smart Multimodal Healthcare Copilot with Powerful LLM ReasoningCode3
TaxAgent: How Large Language Model Designs Fiscal Policy0
TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Models0
Beyond Text Compression: Evaluating Tokenizers Across Scales0
SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligence0
PGPO: Enhancing Agent Reasoning via Pseudocode-style Planning Guided Preference Optimization0
The State of Large Language Models for African Languages: Progress and Challenges0
Hybrid AI for Responsive Multi-Turn Online Conversations with Novel Dynamic Routing and Feedback Adaptation0
Show:102550
← PrevPage 5 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified