SOTAVerified

Language Modelling

A language model is a model of natural language. Language models are useful for a variety of tasks, including speech recognition, machine translation, natural language generation (generating more human-like text), optical character recognition, route optimization, handwriting recognition, grammar induction, and information retrieval.

Large language models (LLMs), currently their most advanced form, are predominantly based on transformers trained on larger datasets (frequently using words scraped from the public internet). They have superseded recurrent neural network-based models, which had previously superseded the purely statistical models, such as word n-gram language model.

Source: Wikipedia

Papers

Showing 22512300 of 17610 papers

TitleStatusHype
LLaRA: Large Language-Recommendation AssistantCode1
Creative Agents: Empowering Agents with Imagination for Creative TasksCode1
Characterizing Large Language Model Geometry Helps Solve Toxicity Detection and GenerationCode1
Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model CommunicationCode1
StoryGPT-V: Large Language Models as Consistent Story VisualizersCode1
Prompting Disentangled Embeddings for Knowledge Graph Completion with Pre-trained Language ModelCode1
Object Recognition as Next Token PredictionCode1
Bootstrapping Interactive Image-Text Alignment for Remote Sensing Image CaptioningCode1
Mark My Words: Analyzing and Evaluating Language Model WatermarksCode1
Dolphins: Multimodal Language Model for DrivingCode1
TCP:Textual-based Class-aware Prompt tuning for Visual-Language ModelCode1
OST: Refining Text Knowledge with Optimal Spatio-Temporal Descriptor for General Video RecognitionCode1
Acoustic Prompt Tuning: Empowering Large Language Models with Audition CapabilitiesCode1
RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational AssistanceCode1
Semantic-Aware Frame-Event Fusion based Pattern Recognition via Large Vision-Language ModelsCode1
TurkishBERTweet: Fast and Reliable Large Language Model for Social Media AnalysisCode1
Contrastive Vision-Language Alignment Makes Efficient Instruction LearnerCode1
Unveiling the Implicit Toxicity in Large Language ModelsCode1
M^2Chat: Empowering VLM for Multimodal LLM Interleaved Text-Image GenerationCode1
ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?Code1
DUnE: Dataset for Unified EditingCode1
Cognitive Dissonance: Why Do Language Model Outputs Disagree with Internal Representations of Truthfulness?Code1
DP-OPT: Make Large Language Model Your Privacy-Preserving Prompt EngineerCode1
Compositional Chain-of-Thought Prompting for Large Multimodal ModelsCode1
Safe-CLIP: Removing NSFW Concepts from Vision-and-Language ModelsCode1
vTrain: A Simulation Framework for Evaluating Cost-effective and Compute-optimal Large Language Model TrainingCode1
InterControl: Zero-shot Human Interaction Generation by Controlling Every JointCode1
Cerbero-7B: A Leap Forward in Language-Specific LLMs Through Enhanced Chat Corpus Generation and EvaluationCode1
Image Super-Resolution with Text Prompt DiffusionCode1
Paragraph-to-Image Generation with Information-Enriched Diffusion ModelCode1
Large Language Model as a Policy Teacher for Training Reinforcement Learning AgentsCode1
ComPEFT: Compression for Communicating Parameter Efficient Updates via Sparsification and QuantizationCode1
Soulstyler: Using Large Language Model to Guide Image Style Transfer for Target ObjectCode1
Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMsCode1
Oasis: Data Curation and Assessment System for Pretraining of Large Language ModelsCode1
Towards Natural Language-Guided Drones: GeoText-1652 Benchmark with Spatial Relation MatchingCode1
Extracting Definienda in Mathematical Scholarly Articles with TransformersCode1
BEND: Benchmarking DNA Language Models on biologically meaningful tasksCode1
Causal Structure Learning Supervised by Large Language ModelCode1
LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model FinetuningCode1
LION : Empowering Multimodal Large Language Model with Dual-Level Visual KnowledgeCode1
Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical TasksCode1
DynaPipe: Optimizing Multi-task Training through Dynamic PipelinesCode1
Distilling and Retrieving Generalizable Knowledge for Robot Manipulation via Language CorrectionsCode1
Language Generation from Brain RecordingsCode1
Accelerating Toeplitz Neural Network with Constant-time Inference ComplexityCode1
Contrastive Chain-of-Thought PromptingCode1
OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued PretrainingCode1
VideoCon: Robust Video-Language Alignment via Contrast CaptionsCode1
Towards Open-Ended Visual Recognition with Large Language ModelCode1
Show:102550
← PrevPage 46 of 353Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Decay RNNValidation perplexity76.67Unverified
2GRUValidation perplexity53.78Unverified
3LSTMValidation perplexity52.73Unverified
4LSTMTest perplexity48.7Unverified
5Temporal CNNTest perplexity45.2Unverified
6TCNTest perplexity45.19Unverified
7GCNN-8Test perplexity44.9Unverified
8Neural cache model (size = 100)Test perplexity44.8Unverified
9Neural cache model (size = 2,000)Test perplexity40.8Unverified
10GPT-2 SmallTest perplexity37.5Unverified
#ModelMetricClaimedVerifiedStatus
1TCNTest perplexity108.47Unverified
2Seq-U-NetTest perplexity107.95Unverified
3GRU (Bai et al., 2018)Test perplexity92.48Unverified
4R-TransformerTest perplexity84.38Unverified
5Zaremba et al. (2014) - LSTM (medium)Test perplexity82.7Unverified
6Gal & Ghahramani (2016) - Variational LSTM (medium)Test perplexity79.7Unverified
7LSTM (Bai et al., 2018)Test perplexity78.93Unverified
8Zaremba et al. (2014) - LSTM (large)Test perplexity78.4Unverified
9Gal & Ghahramani (2016) - Variational LSTM (large)Test perplexity75.2Unverified
10Inan et al. (2016) - Variational RHNTest perplexity66Unverified
#ModelMetricClaimedVerifiedStatus
1LSTM (7 layers)Bit per Character (BPC)1.67Unverified
2HypernetworksBit per Character (BPC)1.34Unverified
3SHA-LSTM (4 layers, h=1024, no attention head)Bit per Character (BPC)1.33Unverified
4LN HM-LSTMBit per Character (BPC)1.32Unverified
5ByteNetBit per Character (BPC)1.31Unverified
6Recurrent Highway NetworksBit per Character (BPC)1.27Unverified
7Large FS-LSTM-4Bit per Character (BPC)1.25Unverified
8Large mLSTMBit per Character (BPC)1.24Unverified
9AWD-LSTM (3 layers)Bit per Character (BPC)1.23Unverified
10Cluster-Former (#C=512)Bit per Character (BPC)1.22Unverified
#ModelMetricClaimedVerifiedStatus
1Smaller Transformer 126M (pre-trained)Test perplexity33Unverified
2OPT 125MTest perplexity32.26Unverified
3Larger Transformer 771M (pre-trained)Test perplexity28.1Unverified
4OPT 1.3BTest perplexity19.55Unverified
5GPT-Neo 125MTest perplexity17.83Unverified
6OPT 2.7BTest perplexity17.81Unverified
7Smaller Transformer 126M (fine-tuned)Test perplexity12Unverified
8GPT-Neo 1.3BTest perplexity11.46Unverified
9Transformer 125MTest perplexity10.7Unverified
10GPT-Neo 2.7BTest perplexity10.44Unverified