SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 65516600 of 17610 papers

TitleStatusHype
Detecting AI-Generated Texts in Cross-DomainsCode0
Comparing the Utility, Preference, and Performance of Course Material Search Functionality and Retrieval-Augmented Generation Large Language Model (RAG-LLM) AI Chatbots in Information-Seeking Tasks0
Advancing Large Language Model Attribution through Self-Improving0
Accounting for Sycophancy in Language Model Uncertainty Estimation0
Collaborative AI in Sentiment Analysis: System Architecture, Data Prediction and Deployment Strategies0
Balancing Label Quantity and Quality for Scalable ElicitationCode0
Exploring the Design Space of Visual Context Representation in Video MLLMsCode0
A Common Pitfall of Margin-based Language Model Alignment: Gradient EntanglementCode0
Evaluating Self-Generated Documents for Enhancing Retrieval-Augmented Generation with Large Language Models0
Breaking Chains: Unraveling the Links in Multi-Hop Knowledge Unlearning0
Instruction-Driven Game Engine: A Poker Case Study0
Retrieval-Enhanced Named Entity Recognition0
Trust but Verify: Programmatic VLM Evaluation in the Wild0
MedINST: Meta Dataset of Biomedical InstructionsCode0
Mitigating Biases to Embrace Diversity: A Comprehensive Annotation Benchmark for Toxic Language0
SBI-RAG: Enhancing Math Word Problem Solving for Students through Schema-Based Instruction and Retrieval-Augmented GenerationCode0
debiaSAE: Benchmarking and Mitigating Vision-Language Model BiasCode0
Text-Guided Multi-Property Molecular Optimization with a Diffusion Language Model0
Towards Hybrid Intelligence in Journalism: Findings and Lessons Learnt from a Collaborative Analysis of Greek Political Rhetoric by ChatGPT and Humans0
Transformer Guided Coevolution: Improved Team Selection in Multiagent Adversarial Team Games0
Reproducibility study of "LICO: Explainable Models with Language-Image Consistency"Code0
Style-Compress: An LLM-Based Prompt Compression Framework Considering Task-Specific Styles0
Proof Flow: Preliminary Study on Generative Flow Network Language Model Tuning for Formal Reasoning0
LLM Agent Honeypot: Monitoring AI Hacking Agents in the Wild0
SLM-Mod: Small Language Models Surpass LLMs at Content ModerationCode0
MedAide: Towards an Omni Medical Aide via Specialized LLM-based Multi-Agent Collaboration0
Negative-Prompt-driven Alignment for Generative Language Model0
Revisited Large Language Model for Time Series Analysis through Modality Alignment0
REFINE on Scarce Data: Retrieval Enhancement through Fine-Tuning via Model Fusion of Embedding Models0
Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuningCode0
Large Language Model-driven Multi-Agent Simulation for News Diffusion Under Different Network Structures0
StyleDistance: Stronger Content-Independent Style Embeddings with Synthetic Parallel Examples0
ShapefileGPT: A Multi-Agent Large Language Model Framework for Automated Shapefile Processing0
Reverse-Engineering the ReaderCode0
Tuning Language Models by Mixture-of-Depths Ensemble0
Optimizing Low-Resource Language Model Training: Comprehensive Analysis of Multi-Epoch, Multi-Lingual, and Two-Stage Approaches0
LFOSum: Summarizing Long-form Opinions with Large Language Models0
Sarcasm Detection in a Less-Resourced LanguageCode0
Mechanistic Unlearning: Robust Knowledge Unlearning and Editing via Mechanistic Localization0
Retrieval-Reasoning Large Language Model-based Synthetic Clinical Trial Generation0
Tracking Universal Features Through Fine-Tuning and Model Merging0
Explainable Moral Values: a neuro-symbolic approach to value classification0
Can We Reverse In-Context Knowledge Edits?0
BenchmarkCards: Large Language Model and Risk Reporting0
End-to-end Planner Training for Language Modeling0
Iter-AHMCL: Alleviate Hallucination for Large Language Model via Iterative Model-level Contrastive Learning0
Developing Question-Answering Models in Low-Resource Languages: A Case Study on Turkish Medical Texts Using Transformer-Based Approaches0
HELM: Hierarchical Encoding for mRNA Language Modeling0
A Framework for Adapting Human-Robot Interaction to Diverse User GroupsCode0
G-Designer: Architecting Multi-agent Communication Topologies via Graph Neural Networks0
Show:102550
← PrevPage 132 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified