SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 19512000 of 17610 papers

TitleStatusHype
CLIP-PCQA: Exploring Subjective-Aligned Vision-Language Modeling for Point Cloud Quality AssessmentCode0
A Vision-Language Framework for Multispectral Scene Representation Using Language-Grounded Features0
FLORA: Formal Language Model Enables Robust Training-free Zero-shot Object Referring Analysis0
Sympathy over Polarization: A Computational Discourse Analysis of Social Media Posts about the July 2024 Trump Assassination Attempt0
Multi-stage Training of Bilingual Islamic LLM for Neural Passage Retrieval0
Hierarchical Autoregressive Transformers: Combining Byte- and Word-Level Processing for Robust, Adaptable Language Models0
BoK: Introducing Bag-of-Keywords Loss for Interpretable Dialogue Response GenerationCode0
Dual Debiasing: Remove Stereotypes and Keep Factual Gender for Fair Language Modeling and Translation0
Steering Large Language Models with Feature Guided Activation Additions0
Evolving Deeper LLM Thinking0
An LLM-Guided Tutoring System for Social Skills Training0
LAVCap: LLM-based Audio-Visual Captioning using Optimal TransportCode1
Making Your Dreams A Reality: Decoding the Dreams into a Coherent Video Story from fMRI Signals0
Augmenting a Large Language Model with a Combination of Text and Visual Data for Conversational Visualization of Global Geospatial Data0
Double Visual Defense: Adversarial Pre-training and Instruction Tuning for Improving Vision-Language Model Robustness0
Beyond Reward Hacking: Causal Rewards for Large Language Model AlignmentCode4
Large Language Model is Secretly a Protein Sequence Optimizer0
Lost in Translation, Found in Context: Sign Language Translation with Contextual Cues0
mGeNTE: A Multilingual Resource for Gender-Neutral Language and Translation0
Induced Model Matching: Restricted Models Help Train Full-Featured ModelsCode0
WhiSPA: Semantically and Psychologically Aligned Whisper with Self-Supervised Contrastive and Student-Teacher LearningCode1
Leveraging LLM Agents for Translating Network Configurations0
MAGNET: Augmenting Generative Decoders with Representation Learning and Infilling Capabilities0
Augmenting Human-Annotated Training Data with Large Language Model Generation and Distillation in Open-Response Assessment0
Monte Carlo Tree Search for Comprehensive Exploration in LLM-Based Automatic Heuristic DesignCode2
LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model0
CityLoc: 6DoF Pose Distributional Localization for Text Descriptions in Large-Scale Scenes with Gaussian Representation0
Applying General Turn-taking Models to Conversational Human-Robot Interaction0
Large Language Models For Text Classification: Case Study And Comprehensive Review0
A Driver Advisory System Based on Large Language Model for High-speed Train0
Hierarchical Autoscaling for Large Language Model Serving with Chiron0
Real-time Verification and Refinement of Language Model Text Generation0
Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video UnderstandingCode4
Exploring Narrative Clustering in Large Language Models: A Layerwise Analysis of BERT0
ADAM-1: AI and Bioinformatics for Alzheimer's Detection and Microbiome-Clinical Data Integrations0
In-situ graph reasoning and knowledge expansion using Graph-PReFLexORCode3
Gandalf the Red: Adaptive Security for LLMsCode1
LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal UnderstandingCode2
3UR-LLM: An End-to-End Multimodal Large Language Model for 3D Scene UnderstandingCode1
Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Marks0
Large Language Model Interface for Home Energy Management Systems0
Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model0
LLM360 K2: Building a 65B 360-Open-Source Large Language Model from Scratch0
Multi-megabase scale genome interpretation with genetic language models0
Pre-Trained Large Language Model Based Remaining Useful Life Transfer Prediction of Bearing0
LLMic: Romanian Foundation Language Model0
Enhancing Image Generation Fidelity via Progressive PromptsCode0
Lifelong Learning of Large Language Model based Agents: A RoadmapCode3
TempoGPT: Enhancing Temporal Reasoning via Quantizing EmbeddingCode0
TiEBe: Tracking Language Model Recall of Notable Worldwide Events Through TimeCode0
Show:102550
← PrevPage 40 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified