SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 751800 of 17610 papers

TitleStatusHype
KoACD: The First Korean Adolescent Dataset for Cognitive Distortion Analysis0
Red Teaming Large Language Models for Healthcare0
FreqKV: Frequency Domain Key-Value Compression for Efficient Context Window Extension0
Data Therapist: Eliciting Domain Knowledge from Subject Matter Experts Using Large Language Models0
Visual Test-time Scaling for GUI Agent GroundingCode1
A Multi-Granularity Retrieval Framework for Visually-Rich Documents0
Urban Air Mobility as a System of Systems: An LLM-Enhanced Holonic Approach0
Optimizing Deep Neural Networks using Safety-Guided Self CompressionCode0
LLM-Based Threat Detection and Prevention Framework for IoT Ecosystems0
A Survey on Large Language Model based Human-Agent SystemsCode0
V3LMA: Visual 3D-enhanced Language Model for Autonomous Driving0
Polysemy of Synthetic Neurons Towards a New Type of Explanatory Categorical Vector Spaces0
Vision-Language Model-Based Semantic-Guided Imaging Biomarker for Early Lung Cancer Detection0
Does the Prompt-based Large Language Model Recognize Students' Demographics and Introduce Bias in Essay Scoring?0
Sadeed: Advancing Arabic Diacritization Through Small Language Model0
Confidence in Large Language Model Evaluation: A Bayesian Approach to Limited-Sample Challenges0
RWKV-X: A Linear Complexity Hybrid Language ModelCode2
MF-LLM: Simulating Population Decision Dynamics via a Mean-Field Large Language Model FrameworkCode1
MemeBLIP2: A novel lightweight multimodal system to detect harmful memes0
BrAIcht, a theatrical agent that speaks like Bertolt Brecht's characters0
CoCo-Bench: A Comprehensive Code Benchmark For Multi-task Large Language Model Evaluation0
Universal language model with the intervention of quantum theory0
UniDetox: Universal Detoxification of Large Language Models via Dataset DistillationCode0
Computational Reasoning of Large Language ModelsCode0
Small or Large? Zero-Shot or Finetuned? Guiding Language Model Choice for Specialized Applications in Healthcare0
WenyanGPT: A Large Language Model for Classical Chinese Tasks0
From Attention to Atoms: Spectral Dictionary Learning for Fast, Interpretable Language Models0
LLM Enhancer: Merged Approach using Vector Embedding for Reducing Large Language Model Hallucinations with External Knowledge0
Reviving Any-Subset Autoregressive Models with Principled Parallel Sampling and Speculative DecodingCode1
LLM-Enabled EV Charging Stations Recommendation0
Pretraining Large Brain Language Model for Active BCI: Silent Speech0
A Framework to Assess the Persuasion Risks Large Language Model Chatbots Pose to Democratic Societies0
GVPO: Group Variance Policy Optimization for Large Language Model Post-Training0
Efficient Domain-adaptive Continual Pretraining for the Process Industry in the German Language0
Fitness Landscape of Large Language Model-Assisted Automated Algorithm Search0
PhenoAssistant: A Conversational Multi-Agent AI System for Automated Plant PhenotypingCode1
CodeBC: A More Secure Large Language Model for Smart Contract Code Generation in BlockchainCode0
An Automated Reinforcement Learning Reward Design Framework with Large Language Model for Cooperative Platoon Coordination0
Unified Multi-Task Learning & Model Fusion for Efficient Language Model Guardrailing0
GenTorrent: Scaling Large Language Model Serving with An Overley Network0
Towards Practical Second-Order Optimizers in Deep Learning: Insights from Fisher Information AnalysisCode2
Improving Language Model Personas via Rationalization with Psychological Scaffolds0
Fast-Slow Thinking for Large Vision-Language Model Reasoning0
LEAM: A Prompt-only Large Language Model-enabled Antenna Modeling MethodCode1
The Big Send-off: High Performance Collectives on GPU-based Supercomputers0
SMARTFinRAG: Interactive Modularized Financial RAG BenchmarkCode0
Exploring a Large Language Model for Transforming Taxonomic Data into OWL: Lessons Learned and Implications for Ontology Development0
Unified Attacks to Large Language Model Watermarks: Spoofing and Scrubbing in Unauthorized Knowledge Distillation0
Does Knowledge Distillation Matter for Large Language Model based Bundle Generation?0
TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation0
Show:102550
← PrevPage 16 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified