SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 23512400 of 17610 papers

TitleStatusHype
POINTS1.5: Building a Vision-Language Model towards Real World Applications0
NyayaAnumana & INLegalLlama: The Largest Indian Legal Judgment Prediction Dataset and Specialized Language Model for Enhanced Decision AnalysisCode1
Concept Bottleneck Large Language ModelsCode1
TurboAttention: Efficient Attention Approximation For High Throughputs LLMs0
Underestimated Privacy Risks for Minority Populations in Large Language Model Unlearning0
Multimodal Latent Language Modeling with Next-Token DiffusionCode0
Template Matters: Understanding the Role of Instruction Templates in Multimodal Language Model Evaluation and TrainingCode1
Position-aware Guided Point Cloud Completion with CLIP Model0
SmolTulu: Higher Learning Rate to Batch Size Ratios Can Lead to Better Reasoning in SLMs0
Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning0
Automatic Item Generation for Personality Situational Judgment Tests with Large Language Models0
Research on the Application of Spark Streaming Real-Time Data Analysis System and large language model Intelligent Agents0
Active Inference for Self-Organizing Multi-LLM Systems: A Bayesian Thermodynamic Approach to AdaptationCode0
Preference Adaptive and Sequential Text-to-Image Generation0
Agents for self-driving laboratories applied to quantum computing0
Neural Scaling Laws Rooted in the Data DistributionCode0
Bayesian Optimization of Antibodies Informed by a Generative Model of Evolving SequencesCode1
RAG-based Question Answering over Heterogeneous Data and Text0
DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation0
Granite GuardianCode2
IntellectSeeker: A Personalized Literature Management System with the Probabilistic Model and Large Language ModelCode0
The Rise and Down of Babel Tower: Investigating the Evolution Process of Multilingual Code Large Language Model0
KULTURE Bench: A Benchmark for Assessing Language Model in Korean Cultural Context0
CoPrUS: Consistency Preserving Utterance Synthesis towards more realistic benchmark dialoguesCode0
MAPLE: A Framework for Active Preference Learning Guided by Large Language Models0
Breaking the Stage Barrier: A Novel Single-Stage Approach to Long Context Extension for Large Language Models0
Filling Memory Gaps: Enhancing Continual Semantic Parsing via SQL Syntax Variance-Guided LLMs without Real Data Replay0
LINKs: Large Language Model Integrated Management for 6G Empowered Digital Twin NetworKs0
Leveraging Prompt Learning and Pause Encoding for Alzheimer's Disease Detection0
Effective Text Adaptation for LLM-based ASR through Soft Prompt Fine-Tuning0
Small Languages, Big Models: A Study of Continual Training on Languages of Norway0
BatchTopK Sparse AutoencodersCode3
LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial RelationsCode1
ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhance0
OmniEvalKit: A Modular, Lightweight Toolbox for Evaluating Large Language Model and its Omni-Extensions0
Simulating Human-like Daily Activities with Desire-driven Autonomy0
Gated Delta Networks: Improving Mamba2 with Delta RuleCode4
Exploring Critical Testing Scenarios for Decision-Making Policies: An LLM Approach0
MAVias: Mitigate any Visual Bias0
Unseen Attack Detection in Software-Defined Networking Using a BERT-Based Large Language Model0
Pre-trained protein language model for codon optimization0
Cooperative SQL Generation for Segmented Databases By Using Multi-functional LLM Agents0
Enhanced Computationally Efficient Long LoRA Inspired Perceiver Architectures for Auto-Regressive Language Modeling0
GL-Fusion: Rethinking the Combination of Graph Neural Network and Large Language model0
LVP-CLIP:Revisiting CLIP for Continual Learning with Label Vector Pool0
Trust No AI: Prompt Injection Along The CIA Security Triad0
SMI-Editor: Edit-based SMILES Language Model with Fragment-level Supervision0
ULMRec: User-centric Large Language Model for Sequential Recommendation0
Confidence Diagram of Nonparametric Ranking for Uncertainty Assessment in Large Language Models Evaluation0
Text-to-3D Gaussian Splatting with Physics-Grounded Motion Generation0
Show:102550
← PrevPage 48 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified