SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 5801–5850 of 17610 papers

TitleStatusHype
Chunk-Distilled Language Modeling—0
Reinforcing Thinking through Reasoning-Enhanced Reward Models—0
Setting Standards in Turkish NLP: TR-MMLU for Large Language Model Evaluation—0
Titans: Learning to Memorize at Test TimeCode0
Towards Sustainable Large Language Model Serving—0
Why Are Positional Encodings Nonessential for Deep Autoregressive Transformers? Revisiting a Petroglyph—0
WalkVLM:Aid Visually Impaired People Walking by Vision Language Model—0
ChartAdapter: Large Vision-Language Model for Chart Summarization—0
HUNYUANPROVER: A Scalable Data Synthesis Framework and Guided Tree Search for Automated Theorem Proving—0
DropMicroFluidAgents (DMFAs): Autonomous Droplet Microfluidic Research Framework Through Large Language Model AgentsCode0
GroverGPT: A Large Language Model with 8 Billion Parameters for Quantum Searching—0
Detection-Fusion for Knowledge Graph Extraction from VideosCode0
AlignAb: Pareto-Optimal Energy Alignment for Designing Nature-Like Antibodies—0
Enhancing Annotated Bibliography Generation with LLM Ensembles—0
Knowledge Editing for Large Language Model with Knowledge Neuronal Ensemble—0
Towards Compatible Fine-tuning for Vision-Language Model Updates—0
Retrieval-Augmented Generation for Mobile Edge Computing via Large Language Model—0
Multi-Objective Large Language Model UnlearningCode0
Adversarial Negotiation Dynamics in Generative Language Models—0
HindiLLM: Large Language Model for Hindi—0
Generative Regression Based Watch Time Prediction for Short-Video Recommendation—0
Improving SSVEP BCI Spellers With Data Augmentation and Language ModelsCode0
ST^3: Accelerating Multimodal Large Language Model by Spatial-Temporal Visual Token Trimming—0
MLLM-SUL: Multimodal Large Language Model for Semantic Scene Understanding and Localization in Traffic ScenariosCode0
Xmodel-2 Technical ReportCode0
Zero-shot Hazard Identification in Autonomous Driving: A Case Study on the COOOL Benchmark—0
InfAlign: Inference-aware language model alignment—0
From Interests to Insights: An LLM Approach to Course Recommendations Using Natural Language QueriesCode0
"I've Heard of You!": Generate Spoken Named Entity Recognition Data for Unseen EntitiesCode0
Multi-Attribute Constraint Satisfaction via Language Model Rewriting—0
SILC-EFSA: Self-aware In-context Learning Correction for Entity-level Financial Sentiment AnalysisCode0
Speech Recognition With LLMs Adapted to Disordered Speech Using Reinforcement Learning—0
Optimizing Large Language Models with an Enhanced LoRA Fine-Tuning Algorithm for Efficiency and Robustness in NLP Tasks—0
Torque-Aware Momentum—0
PhyloGen: Language Model-Enhanced Phylogenetic Inference via Graph Structure Generation—0
Bootstrap Your Own Context Length—0
Efficient and Context-Aware Label Propagation for Zero-/Few-Shot Training-Free Adaptation of Vision-Language Model—0
CoAM: Corpus of All-Type Multiword Expressions—0
From Hallucinations to Facts: Enhancing Language Models with Curated Knowledge Graphs—0
Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justice—0
Generating event descriptions under syntactic and semantic constraintsCode0
GeneSUM: Large Language Model-based Gene Summary Extraction—0
Is Large Language Model Good at Triple Set Prediction? An Empirical Study—0
Efficient Long Context Language Model Retrieval with Compression—0
Consistency Checks for Language Model Forecasters—0
INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent—0
Real-world Deployment and Evaluation of PErioperative AI CHatbot (PEACH) -- a Large Language Model Chatbot for Perioperative Medicine—0
TAB: Transformer Attention Bottlenecks enable User Intervention and Debugging in Vision-Language ModelsCode0
LSAQ: Layer-Specific Adaptive Quantization for Large Language Model Deployment—0
Molly: Making Large Language Model Agents Solve Python Problem More Logically—0
Show:102550
← PrevPage 117 of 353Next →
All datasetsWikiText-103Penn Treebank (Word Level)enwik8The PileWikiText-2LAMBADAOne Billion WordText8Penn Treebank (Character Level)Hutter PrizeOpenWebTextSALMon

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67—Unverified
2GRUValidation perplexity53.78—Unverified
3LSTMValidation perplexity52.73—Unverified
4LSTMTest perplexity48.7—Unverified
5Temporal CNNTest perplexity45.2—Unverified
6TCNTest perplexity45.19—Unverified
7GCNN-8Test perplexity44.9—Unverified
8Neural cache model (size = 100)Test perplexity44.8—Unverified
9Neural cache model (size = 2,000)Test perplexity40.8—Unverified
10GPT-2 SmallTest perplexity37.5—Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47—Unverified
2Seq-U-NetTest perplexity107.95—Unverified
3GRU (Bai et al., 2018)Test perplexity92.48—Unverified
4R-TransformerTest perplexity84.38—Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7—Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7—Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93—Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4—Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2—Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66—Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67—Unverified
2HypernetworksBit per Character (BPC)1.34—Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33—Unverified
4LN HM-LSTMBit per Character (BPC)1.32—Unverified
5ByteNetBit per Character (BPC)1.31—Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27—Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25—Unverified
8Large mLSTMBit per Character (BPC)1.24—Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23—Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33—Unverified
2OPT 125MTest perplexity32.26—Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1—Unverified
4OPT 1.3BTest perplexity19.55—Unverified
5GPT-Neo 125MTest perplexity17.83—Unverified
6OPT 2.7BTest perplexity17.81—Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12—Unverified
8GPT-Neo 1.3BTest perplexity11.46—Unverified
9Transformer 125MTest perplexity10.7—Unverified
10GPT-Neo 2.7BTest perplexity10.44—Unverified