SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 90019050 of 17610 papers

TitleStatusHype
SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence UnderstandingCode2
Enhancing Recommender Systems with Large Language Model Reasoning Graphs0
COCA: Classifier-Oriented Calibration via Textual Prototype for Source-Free Universal Domain AdaptationCode0
Can Language Models Learn to Listen?0
Fact-checking information from large language models can decrease headline discernmentCode1
Indonesian Automatic Speech Recognition with XLSR-530
Steering Language Models With Activation EngineeringCode1
FoodGPT: A Large Language Model in Food Testing Domain with Incremental Pre-training and Knowledge Graph Prompt0
cantnlp@LT-EDI-2023: Homophobia/Transphobia Detection in Social Media Comments using Spatio-Temporally Retrained Language Models0
ChatEDA: A Large Language Model Powered Autonomous Agent for EDACode1
Imaginations of WALL-E : Reconstructing Experiences with an Imagination-Inspired Module for Advanced AI Systems0
Can ChatGPT replace StackOverflow? A Study on Robustness and Reliability of Large Language Model Code GenerationCode1
DUAW: Data-free Universal Adversarial Watermark against Stable Diffusion Customization0
PACE: Improving Prompt with Actor-Critic Editing for Large Language Model0
Inductive-bias Learning: Generating Code Models with Large Language ModelCode0
BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine0
Conversational Ontology Alignment with ChatGPT0
Exploring Sampling Techniques for Generating Melodies with a Transformer Language Model0
Differentiable Retrieval Augmentation via Generative Language Modeling for E-commerce Query Intent Classification0
Latent State Models of Training DynamicsCode0
OCR Language Models with Custom Vocabularies0
PUMGPT: A Large Vision-Language Model for Product Understanding0
ChatHaruhi: Reviving Anime Character in Reality via Large Language ModelCode4
BERT4CTR: An Efficient Framework to Combine Pre-trained Language Model with Non-textual Features for CTR Prediction0
Contrasting Linguistic Patterns in Human and LLM-Generated News Text0
Fine-grained Text and Image Guided Point Cloud Completion with CLIP Model0
End-to-End Beam Retrieval for Multi-Hop Question AnsweringCode1
Chinese Spelling Correction as Rephrasing Language ModelCode1
Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D ScenesCode2
Reinforced Self-Training (ReST) for Language Modeling0
Language-enhanced RNR-Map: Querying Renderable Neural Radiance Field maps with natural languageCode1
LLM-FuncMapper: Function Identification for Interpreting Complex Clauses in Building Codes via LLM0
Towards Automatically Addressing Self-Admitted Technical Debt: How Far Are We?Code0
BIOptimus: Pre-training an Optimal Biomedical Language Model with Curriculum Learning for Named Entity RecognitionCode0
ChatLogo: A Large Language Model-Driven Hybrid Natural-Programming Language Interface for Agent-based Modeling and Programming0
CMD: a framework for Context-aware Model self-DetoxificationCode1
FootGPT : A Large Language Model Development Experiment on a Minimal Setting0
Visually-Aware Context Modeling for News Image CaptioningCode0
TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time SeriesCode1
PEvoLM: Protein Sequence Evolutionary Information Language ModelCode1
Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme DetectionCode1
Separate the Wheat from the Chaff: Model Deficiency Unlearning via Parameter-Efficient Module OperationCode1
Pre-training with Large Language Model-based Document Expansion for Dense Passage Retrieval0
SPM: Structured Pretraining and Matching Architectures for Relevance Modeling in Meituan Search0
Emerging Frontiers: Exploring the Impact of Generative AI Platforms on University Quantitative Finance Examinations0
Domain Adaptation for Code Model-based Unit Test Case Generation0
A Foundation Language-Image Model of the Retina (FLAIR): Encoding Expert Knowledge in Text SupervisionCode1
RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language ModelsCode0
Correct and Optimal: the Regular Expression Inference Challenge0
LLM-Mini-CEX: Automatic Evaluation of Large Language Model for Diagnostic Conversation0
Show:102550
← PrevPage 181 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified