SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 2151–2200 of 17610 papers

TitleStatusHype
Zero-shot Hazard Identification in Autonomous Driving: A Case Study on the COOOL Benchmark—0
MLLM-SUL: Multimodal Large Language Model for Semantic Scene Understanding and Localization in Traffic ScenariosCode0
A Survey on Large Language Model Acceleration based on KV Cache ManagementCode3
Xmodel-2 Technical ReportCode0
InfAlign: Inference-aware language model alignment—0
An Engorgio Prompt Makes Large Language Model Babble onCode1
DeepSeek-V3 Technical ReportCode16
ETTA: Elucidating the Design Space of Text-to-Audio ModelsCode2
RecLM: Recommendation Instruction TuningCode2
"I've Heard of You!": Generate Spoken Named Entity Recognition Data for Unseen EntitiesCode0
Multi-Attribute Constraint Satisfaction via Language Model Rewriting—0
SILC-EFSA: Self-aware In-context Learning Correction for Entity-level Financial Sentiment AnalysisCode0
From Interests to Insights: An LLM Approach to Course Recommendations Using Natural Language QueriesCode0
Speech Recognition With LLMs Adapted to Disordered Speech Using Reinforcement Learning—0
Optimizing Large Language Models with an Enhanced LoRA Fine-Tuning Algorithm for Efficiency and Robustness in NLP Tasks—0
Bootstrap Your Own Context Length—0
Torque-Aware Momentum—0
PhyloGen: Language Model-Enhanced Phylogenetic Inference via Graph Structure Generation—0
From Hallucinations to Facts: Enhancing Language Models with Curated Knowledge Graphs—0
TAB: Transformer Attention Bottlenecks enable User Intervention and Debugging in Vision-Language ModelsCode0
Molly: Making Large Language Model Agents Solve Python Problem More Logically—0
VisionLLM-based Multimodal Fusion Network for Glottic Carcinoma Early Detection—0
CoAM: Corpus of All-Type Multiword Expressions—0
Real-world Deployment and Evaluation of PErioperative AI CHatbot (PEACH) -- a Large Language Model Chatbot for Perioperative Medicine—0
Efficient and Context-Aware Label Propagation for Zero-/Few-Shot Training-Free Adaptation of Vision-Language Model—0
Zero-resource Speech Translation and Recognition with LLMs—0
Learning to engineer protein flexibilityCode1
GeneSUM: Large Language Model-based Gene Summary Extraction—0
KunServe: Efficient Parameter-centric Memory Management for LLM Serving—0
Long-Form Speech Generation with Spoken Language ModelsCode2
Efficient Long Context Language Model Retrieval with Compression—0
LSAQ: Layer-Specific Adaptive Quantization for Large Language Model Deployment—0
Agents on the Bench: Large Language Model Based Multi Agent Framework for Trustworthy Digital Justice—0
INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent—0
PLD-Tree: Persistent Laplacian Decision Tree for Protein-Protein Binding Free Energy Prediction—0
Is Large Language Model Good at Triple Set Prediction? An Empirical Study—0
Generating event descriptions under syntactic and semantic constraintsCode0
Scaling Capability in Token Space: An Analysis of Large Vision Language ModelCode0
Consistency Checks for Language Model Forecasters—0
Dynamic Multi-Agent Orchestration and Retrieval for Multi-Source Question-Answer Systems using Large Language Models—0
Contrato360 2.0: A Document and Database-Driven Question-Answer System using Large Language Models and Agents—0
VITRO: Vocabulary Inversion for Time-series Representation Optimization—0
BenCzechMark : A Czech-centric Multitask and Multimetric Benchmark for Large Language Models with Duel Scoring Mechanism—0
Interweaving Memories of a Siamese Large Language ModelCode0
YuLan-Mini: An Open Data-efficient Language ModelCode3
Just What You Desire: Constrained Timeline Summarization with Self-Reflection for Enhanced RelevanceCode0
Measuring Contextual Informativeness in Child-Directed TextCode0
GQSA: Group Quantization and Sparsity for Accelerating Large Language Model Inference—0
Brain-to-Text Benchmark '24: Lessons LearnedCode1
GCS-M3VLT: Guided Context Self-Attention based Multi-modal Medical Vision Language Transformer for Retinal Image Captioning—0
Show:102550
← PrevPage 44 of 353Next →
All datasetsWikiText-103Penn Treebank (Word Level)enwik8The PileWikiText-2LAMBADAOne Billion WordText8Penn Treebank (Character Level)Hutter PrizeOpenWebTextSALMon

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67—Unverified
2GRUValidation perplexity53.78—Unverified
3LSTMValidation perplexity52.73—Unverified
4LSTMTest perplexity48.7—Unverified
5Temporal CNNTest perplexity45.2—Unverified
6TCNTest perplexity45.19—Unverified
7GCNN-8Test perplexity44.9—Unverified
8Neural cache model (size = 100)Test perplexity44.8—Unverified
9Neural cache model (size = 2,000)Test perplexity40.8—Unverified
10GPT-2 SmallTest perplexity37.5—Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47—Unverified
2Seq-U-NetTest perplexity107.95—Unverified
3GRU (Bai et al., 2018)Test perplexity92.48—Unverified
4R-TransformerTest perplexity84.38—Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7—Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7—Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93—Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4—Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2—Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66—Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67—Unverified
2HypernetworksBit per Character (BPC)1.34—Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33—Unverified
4LN HM-LSTMBit per Character (BPC)1.32—Unverified
5ByteNetBit per Character (BPC)1.31—Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27—Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25—Unverified
8Large mLSTMBit per Character (BPC)1.24—Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23—Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22—Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33—Unverified
2OPT 125MTest perplexity32.26—Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1—Unverified
4OPT 1.3BTest perplexity19.55—Unverified
5GPT-Neo 125MTest perplexity17.83—Unverified
6OPT 2.7BTest perplexity17.81—Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12—Unverified
8GPT-Neo 1.3BTest perplexity11.46—Unverified
9Transformer 125MTest perplexity10.7—Unverified
10GPT-Neo 2.7BTest perplexity10.44—Unverified