SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 14511500 of 17610 papers

TitleStatusHype
Citrus: Leveraging Expert Cognitive Pathways in a Medical Language Model for Advanced Medical Decision SupportCode2
LDGen: Enhancing Text-to-Image Synthesis via Large Language Model-Driven Language Representation0
PyEvalAI: AI-assisted evaluation of Jupyter Notebooks for immediate personalized feedback0
Rank1: Test-Time Compute for Reranking in Information RetrievalCode2
AfroXLMR-Comet: Multilingual Knowledge Distillation with Attention Matching for Low-Resource languages0
olmOCR: Unlocking Trillions of Tokens in PDFs with Vision Language ModelsCode11
Independent Mobility GPT (IDM-GPT): A Self-Supervised Multi-Agent Large Language Model Framework for Customized Traffic Mobility Analysis Using Machine Learning Models0
Steering Language Model to Stable Speech Emotion Recognition via Contextual Perception and Chain of ThoughtCode1
Inverse Materials Design by Large Language Model-Assisted Generative FrameworkCode1
NotaGen: Advancing Musicality in Symbolic Music Generation with Large Language Model Training ParadigmsCode5
Iterative Counterfactual Data AugmentationCode0
Large Language Model Driven Agents for Simulating Echo Chamber Formation0
A Combinatorial Identities Benchmark for Theorem Proving via Automated Theorem Generation0
Improving Interactive Diagnostic Ability of a Large Language Model Agent Through Clinical Experience Learning0
Intention Recognition in Real-Time Interactive Navigation MapsCode0
Knowledge Distillation with Training Wheels0
How Do Large Language Monkeys Get Their Power (Laws)?0
Forecasting Rare Language Model Behaviors0
Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs0
From Perceptions to Decisions: Wildfire Evacuation Decision Prediction with Behavioral Theory-informed LLMsCode0
SPARC: Score Prompting and Adaptive Fusion for Zero-Shot Multi-Label Recognition in Vision-Language Models0
Introducing Visual Perception Token into Multimodal Large Language ModelCode2
Balancing Speech Understanding and Generation Using Continual Pre-training for Codec-based Speech LLM0
An Enhanced Large Language Model For Cross Modal Query Understanding System Using DL-KeyBERT Based CAZSSCL-MPGPT0
Baichuan-Audio: A Unified Framework for End-to-End Speech InteractionCode3
Real-time Monitoring of Economic Shocks using Company Websites0
IGDA: Interactive Graph Discovery through Large Language Model Agents0
Thus Spake Long-Context Large Language Model0
Time series forecasting based on optimized LLM for fault prediction in distribution power grid insulators0
Understanding the Uncertainty of LLM Explanations: A Perspective Based on Reasoning Topology0
Reasoning with Latent Thoughts: On the Power of Looped Transformers0
Predicting Liquidity-Aware Bond Yields using Causal GANs and Deep Reinforcement Learning with LLM Evaluation0
Language Model Re-rankers are Steered by Lexical Similarities0
DIS-CO: Discovering Copyrighted Content in VLMs Training DataCode0
Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public OpinionsCode1
Zero-shot Load Forecasting for Integrated Energy Systems: A Large Language Model-based Framework with Multi-task Learning0
Sarang at DEFACTIFY 4.0: Detecting AI-Generated Text Using Noised Data and an Ensemble of DeBERTa Models0
R1-Onevision:An Open-Source Multimodal Large Language Model Capable of Deep ReasoningCode4
MV-CLAM: Multi-View Molecular Interpretation with Cross-Modal Projection via Language ModelCode0
Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Engines0
Sequence-level Large Language Model Training with Contrastive Preference Optimization0
QWENDY: Gene Regulatory Network Inference Enhanced by Large Language Model and Transformer0
Recurrent Knowledge Identification and Fusion for Language Model Continual Learning0
Large Language Model for Lossless Image Compression with Visual Prompts0
A Framework for Evaluating Vision-Language Model Safety: Building Trust in AI for Public Sector Applications0
ZiGong 1.0: A Large Language Model for Financial Credit0
LitLinker: Supporting the Ideation of Interdisciplinary Contexts with Large Language Models for Teaching Literature in Elementary SchoolsCode0
Echo: A Large Language Model with Temporal Episodic Memory0
Exploring Sentiment Manipulation by LLM-Enabled Intelligent Trading Agents0
Human Preferences in Large Language Model Latent Space: A Technical Analysis on the Reliability of Synthetic Data in Voting Outcome Prediction0
Show:102550
← PrevPage 30 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified