SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 48014850 of 17610 papers

TitleStatusHype
How Many Parameters Does it Take to Change a Light Bulb? Evaluating Performance in Self-Play of Conversational Games as a Function of Model Characteristics0
Exploring Spatial Representations in the Historical Lake District Texts with LLM-based Relation Extraction0
CityBench: Evaluating the Capabilities of Large Language Models for Urban TasksCode1
AspirinSum: an Aspect-based utility-preserved de-identification Summarization framework0
Revealing Vision-Language Integration in the Brain with Multimodal NetworksCode0
LiveMind: Low-latency Large Language Models with Simultaneous InferenceCode1
Enhancing the LLM-Based Robot Manipulation Through Human-Robot Collaboration0
APEER: Automatic Prompt Engineering Enhances Large Language Model Reranking0
Information Guided Regularization for Fine-tuning Language ModelsCode0
VLBiasBench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-Language ModelCode1
ReaL: Efficient RLHF Training of Large Language Models with Parameter Reallocation0
SynDARin: Synthesising Datasets for Automated Reasoning in Low-Resource Languages0
Enhancing Language Model Factuality via Activation-Based Confidence Calibration and Guided DecodingCode0
Transferable speech-to-text large language model alignment module0
Enhancing Collaborative Semantics of Language Model-Driven Recommendations via Graph-Aware Learning0
PathoLM: Identifying pathogenicity from the DNA sequence through the Genome Foundation ModelCode0
From Single Agent to Multi-Agent: Improving Traffic Signal Control0
Enhancing Travel Choice Modeling with Large Language Models: A Prompt-Learning Approach0
VisualRWKV: Exploring Recurrent Neural Networks for Visual Language ModelsCode3
The Impact of Auxiliary Patient Data on Automated Chest X-Ray Report Generation and How to Incorporate It0
Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component AnalysisCode1
In-Context Former: Lightning-fast Compressing Context for Large Language Model0
On AI-Inspired UI-DesignCode1
Elliptical AttentionCode0
Improving Visual Commonsense in Language Models via Multiple Image GenerationCode1
Towards Holistic Language-video Representation: the language model-enhanced MSR-Video to Text Dataset0
APPL: A Prompt Programming Language for Harmonious Integration of Programs and Large Language Model PromptsCode3
Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration0
LIT: Large Language Model Driven Intention Tracking for Proactive Human-Robot Collaboration -- A Robot Sous-Chef Application0
Large Language Models are Biased Because They Are Large Language Models0
Block-level Text Spotting with LLMs0
VELO: A Vector Database-Assisted Cloud-Edge Collaborative LLM QoS Optimization Framework0
BiLD: Bi-directional Logits Difference Loss for Large Language Model DistillationCode1
Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU TasksCode2
Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets0
WikiContradict: A Benchmark for Evaluating LLMs on Real-World Knowledge Conflicts from Wikipedia0
GPT Czech Poet: Generation of Czech Poetic Strophes with Language Models0
Improving Text-To-Audio Models with Synthetic CaptionsCode5
MaskPure: Improving Defense Against Text Adversaries with Stochastic PurificationCode0
MolecularGPT: Open Large Language Model (LLM) for Few-Shot Molecular Property PredictionCode1
Detecting Errors through Ensembling Prompts (DEEP): An End-to-End LLM Framework for Detecting Factual ErrorsCode0
Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages0
Not Everything is All You Need: Toward Low-Redundant Optimization for Large Language Model AlignmentCode0
LightPAL: Lightweight Passage Retrieval for Open Domain Multi-Document Summarization0
AgentReview: Exploring Peer Review Dynamics with LLM AgentsCode2
Applying Ensemble Methods to Model-Agnostic Machine-Generated Text Detection0
UrbanLLM: Autonomous Urban Activity Planning and Management with Large Language Models0
QOG:Question and Options Generation based on Language Model0
DetectBench: Can Large Language Model Detect and Piece Together Implicit Evidence?Code0
Stealth edits to large language modelsCode0
Show:102550
← PrevPage 97 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified