SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 87518800 of 17610 papers

TitleStatusHype
FoleyGen: Visually-Guided Audio Generation0
Discrete Audio Representation as an Alternative to Mel-Spectrograms for Speaker and Speech Recognition0
Harnessing the Zero-Shot Power of Instruction-Tuned Large Language Model in End-to-End Speech Recognition0
Exploring Iterative Enhancement for Improving Learnersourced Multiple-Choice Question Explanations with Large Language ModelsCode0
Estimating Contamination via Perplexity: Quantifying Memorisation in Language Model EvaluationCode1
Explaining Agent Behavior with Large Language Models0
CFGPT: Chinese Financial Assistant with Large Language ModelCode1
AI Foundation Models for Weather and Climate: Applications, Design, and Implementation0
End-to-End Speech Recognition Contextualization with Large Language Models0
A Hierarchical Neural Framework for Classification and its Explanation in Large Unstructured Legal Documents0
Semi-Autoregressive Streaming ASR With Label Context0
Leveraging Speech PTM, Text LLM, and Emotional TTS for Speech Emotion Recognition0
Investigating the Catastrophic Forgetting in Multimodal Large Language Models0
Large language models can accurately predict searcher preferencesCode1
PICK: Polished & Informed Candidate Scoring for Knowledge-Grounded Dialogue SystemsCode0
Language Modeling Is CompressionCode1
LMDX: Language Model-based Document Information Extraction and Localization0
LLM Platform Security: Applying a Systematic Evaluation Framework to OpenAI's ChatGPT PluginsCode1
Natural Language Embedded Programs for Hybrid Language Symbolic ReasoningCode1
Reformulating Sequential Recommendation: Learning Dynamic User Interest with Content-enriched Language ModelingCode0
Mixed-Distil-BERT: Code-mixed Language Modeling for Bangla, English, and Hindi0
Pointing out Human Answer Mistakes in a Goal-Oriented Visual Dialogue0
RadOnc-GPT: A Large Language Model for Radiation Oncology0
Corpus Synthesis for Zero-shot ASR domain Adaptation using Large Language Models0
AMuRD: Annotated Arabic-English Receipt Dataset for Key Information Extraction and ClassificationCode0
Adapting Large Language Models to Domains via Reading Comprehension0
Speaker attribution in German parliamentary debates with QLoRA-adapted large language modelsCode0
Progressive Text-to-Image Diffusion with Soft Latent DirectionCode1
The ParlaSent Multilingual Training Dataset for Sentiment Identification in Parliamentary Proceedings0
Towards Ontology Construction with Language Models0
Efficient Avoidance of Vulnerabilities in Auto-completed Smart Contract Code Using Vulnerability-constrained Decoding0
A novel approach to measuring the scope of patent claims based on probabilities obtained from (large) language models0
Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News ArticlesCode1
From Cooking Recipes to Robot Task Trees -- Improving Planning Correctness and Task Efficiency by Leveraging LLMs with a Knowledge Network0
OWL: A Large Language Model for IT OperationsCode2
Performance of the Pre-Trained Large Language Model GPT-4 on Automated Short Answer Grading0
Talk2Care: Facilitating Asynchronous Patient-Provider Communication with Large-Language-Model0
Do Large GPT Models Discover Moral Dimensions in Language Representations? A Topological Study Of Sentence Embeddings0
Enhancing Large Language Model Induced Task-Oriented Dialogue Systems Through Look-Forward Motivated Goals0
Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHFCode1
S3-DST: Structured Open-Domain Dialogue Segmentation and State Tracking in the Era of LLMs0
Find What You Want: Learning Demand-conditioned Object Attribute Space for Demand-driven NavigationCode1
InvestLM: A Large Language Model for Investment using Financial Domain Instruction TuningCode1
MAPLE: Mobile App Prediction Leveraging Large Language Model EmbeddingsCode0
MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query ResponseCode1
Stack-and-Delay: a new codebook pattern for music generation0
t-SOT FNT: Streaming Multi-talker ASR with Text-only Domain Adaptation Capability0
Vocabulary-level Memory Efficiency for Language Model Fine-tuningCode0
Enhance audio generation controllability through representation similarity regularization0
BioinspiredLLM: Conversational Large Language Model for the Mechanics of Biological and Bio-inspired Materials0
Show:102550
← PrevPage 176 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified