SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 84518500 of 17610 papers

TitleStatusHype
Towards Evaluating Generalist Agents: An Automated Benchmark in Open WorldCode1
Mapping Memes to Words for Multimodal Hateful Meme ClassificationCode1
Prometheus: Inducing Fine-grained Evaluation Capability in Language ModelsCode7
QASiNa: Religious Domain Question Answering using Sirah NabawiyahCode0
Large Language Models for Scientific Synthesis, Inference and ExplanationCode1
Promptor: A Conversational and Autonomous Prompt Generation Agent for Intelligent Text Entry Techniques0
Toward Joint Language Modeling for Speech Units and Text0
Language Models are Universal EmbeddersCode1
Multimodal Large Language Model for Visual Navigation0
GameGPT: Multi-agent Collaborative Framework for Game Development0
Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning AbilityCode0
Expanding the Vocabulary of BERT for Knowledge Base ConstructionCode0
Context Compression for Auto-regressive Transformers with Sentinel TokensCode1
Harnessing Large Language Models' Empathetic Response Generation Capabilities for Online Mental Health Counselling Support0
GraphextQA: A Benchmark for Evaluating Graph-Enhanced Large Language ModelsCode0
Ziya-Visual: Bilingual Large Vision-Language Model via Multi-Task Instruction Tuning0
Towards Robust Multi-Modal Reasoning via Model SelectionCode1
DistillSpec: Improving Speculative Decoding via Knowledge Distillation0
HoneyBee: Progressive Instruction Finetuning of Large Language Models for Materials ScienceCode1
On the Relationship between Sentence Analogy Identification and Sentence Structure Encoding in Large Language ModelsCode0
Crosslingual Structural Priming and the Pre-Training Dynamics of Bilingual Language Models0
Measuring Feature Sparsity in Language Models0
LangNav: Language as a Perceptual Representation for Navigation0
Language Models As Semantic IndexersCode1
MatChat: A Large Language Model and Application Service Platform for Materials Science0
LLark: A Multimodal Instruction-Following Language Model for MusicCode2
From Supervised to Generative: A Novel Paradigm for Tabular Deep Learning with Large Language ModelsCode0
PHALM: Building a Knowledge Graph from Scratch by Prompting Humans and a Language ModelCode1
MatFormer: Nested Transformer for Elastic InferenceCode1
Typing to Listen at the Cocktail Party: Text-Guided Target Speaker ExtractionCode1
Ferret: Refer and Ground Anything Anywhere at Any GranularityCode5
ClausewitzGPT Framework: A New Frontier in Theoretical Large Language Model Enhanced Information Operations0
Fast-ELECTRA for Efficient Pre-training0
CacheGen: KV Cache Compression and Streaming for Fast Large Language Model ServingCode5
Cognate Transformer for Automated Phonological Reconstruction and Cognate Reflex PredictionCode0
A Comparative Study of Pre-trained CNNs and GRU-Based Attention for Image Caption Generation0
A Resilient and Accessible Distribution-Preserving Watermark for Large Language ModelsCode0
Acoustic Model Fusion for End-to-end Speech Recognition0
Answer Candidate Type Selection: Text-to-Text Language Model for Closed Book Question Answering Meets Knowledge Graphs0
Prosody Analysis of AudiobooksCode0
The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False DatasetsCode1
Sheared LLaMA: Accelerating Language Model Pre-training via Structured PruningCode2
Learning Multiplex Representations on Text-Attributed Graphs with One Language Model EncoderCode0
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?Code4
Mistral 7BCode6
MuseChat: A Conversational Music Recommendation System for VideosCode0
Making Large Language Models Perform Better in Knowledge Graph CompletionCode2
SEER : A Knapsack approach to Exemplar Selection for In-Context HybridQACode0
Jailbreak and Guard Aligned Language Models with Only Few In-Context Demonstrations0
Bridging Items and Language: A Transition Paradigm for Large Language Model-Based Recommendation0
Show:102550
← PrevPage 170 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified