SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 59516000 of 17610 papers

TitleStatusHype
Continuous Language Model Interpolation for Dynamic and Controllable Text GenerationCode0
Frontier AI Ethics: Anticipating and Evaluating the Societal Impacts of Language Model Agents0
Toward Cross-Layer Energy Optimizations in AI Systems0
MedRG: Medical Report Grounding with Multi-modal Large Language Model0
Improving Language Model Reasoning with Self-motivated Learning0
BRAVE: Broadening the visual encoding of vision-language models0
UMBRAE: Unified Multimodal Brain DecodingCode2
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionCode4
ORacle: Large Vision-Language Models for Knowledge-Guided Holistic OR Domain ModelingCode1
Learn from Failure: Fine-Tuning LLMs with Trial-and-Error Data for Intuitionistic Propositional Logic ProvingCode0
GUIDE: Graphical User Interface Data for Execution0
Less is More for Improving Automatic Evaluation of Factual Consistency0
FreeEval: A Modular Framework for Trustworthy and Efficient Evaluation of Large Language ModelsCode1
Optimization Methods for Personalizing Large Language Models through Retrieval AugmentationCode2
Anchor-based Robust Finetuning of Vision-Language Models0
Prompt-driven Universal Model for View-Agnostic Echocardiography Analysis0
Visually Descriptive Language Model for Vector Graphics ReasoningCode9
On the Effect of (Near) Duplicate Subwords in Language ModellingCode0
Event Extraction in Basque: Typologically motivated Cross-Lingual Transfer-Learning Analysis0
Enhancing Decision Analysis with a Large Language Model: pyDecision a Comprehensive Library of MCDA Methods in PythonCode3
InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDCode0
Elephants Never Forget: Memorization and Learning of Tabular Data in Large Language ModelsCode1
AgentsCoDriver: Large Language Model Empowered Collaborative Driving with Lifelong Learning0
Does Transformer Interpretability Transfer to RNNs?Code1
Rethinking How to Evaluate Language Model JailbreakCode1
Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning0
Is English the New Programming Language? How About Pseudo-code Engineering?0
Xiwu: A Basis Flexible and Learnable LLM for High Energy PhysicsCode1
Progressive Alignment with VLM-LLM Feature to Augment Defect Classification for the ASE Dataset0
PromptAD: Learning Prompts with only Normal Samples for Few-Shot Anomaly DetectionCode3
LLM-Augmented Retrieval: Enhancing Retrieval Models Through Language Models and Doc-Level Embedding0
Chinese Sequence Labeling with Semi-Supervised Boundary-Aware Language Model Pre-training0
Enhancing Clinical Efficiency through LLM: Discharge Note Generation for Cardiac Patients0
SpeechAlign: Aligning Speech Generation to Human PreferencesCode5
Test-Time Zero-Shot Temporal Action LocalizationCode2
Synergy of Large Language Model and Model Driven Engineering for Automated Development of Centralized Vehicular Systems0
VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical Domain0
Have You Merged My Model? On The Robustness of Large Language Model IP Protection Methods Against Model MergingCode1
Guiding Large Language Models to Generate Computer-Parsable Content0
LTNER: Large Language Model Tagging for Named Entity Recognition with Contextualized Entity Marking0
SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model SafetyCode0
MoMA: Multimodal LLM Adapter for Fast Personalized Image GenerationCode3
Unbridled Icarus: A Survey of the Potential Perils of Image Inputs in Multimodal Large Language Model Security0
360^REA: Towards A Reusable Experience Accumulation with 360° Assessment for Multi-Agent SystemCode0
Retrieval-Augmented Open-Vocabulary Object DetectionCode1
OPSD: an Offensive Persian Social media Dataset and its baseline evaluations0
DLoRA: Distributed Parameter-Efficient Fine-Tuning Solution for Large Language Model0
Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generation0
Your Finetuned Large Language Model is Already a Powerful Out-of-distribution Detector0
Multilingual Large Language Model: A Survey of Resources, Taxonomy and Frontiers0
Show:102550
← PrevPage 120 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified