| CogView2: Faster and Better Text-to-Image Generation via Hierarchical Transformers | Apr 28, 2022 | Image GenerationLanguage Modeling | CodeCode Available | 2 |
| DiffCSE: Difference-based Contrastive Learning for Sentence Embeddings | Apr 21, 2022 | Contrastive LearningLanguage Modeling | CodeCode Available | 2 |
| PaLM: Scaling Language Modeling with Pathways | Apr 5, 2022 | Auto DebuggingCode Generation | CodeCode Available | 2 |
| Do As I Can, Not As I Say: Grounding Language in Robotic Affordances | Apr 4, 2022 | Decision MakingLanguage Modeling | CodeCode Available | 2 |
| PromptDet: Towards Open-vocabulary Detection using Uncurated Images | Mar 30, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| LinkBERT: Pretraining Language Models with Document Links | Mar 29, 2022 | Document ClassificationLanguage Modeling | CodeCode Available | 2 |
| STaR: Bootstrapping Reasoning With Reasoning | Mar 28, 2022 | Common Sense ReasoningLanguage Modeling | CodeCode Available | 2 |
| Recommendation as Language Processing (RLP): A Unified Pretrain, Personalized Prompt & Predict Paradigm (P5) | Mar 24, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Memorizing Transformers | Mar 16, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| PERT: Pre-training BERT with Permuted Language Model | Mar 14, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Block-Recurrent Transformers | Mar 11, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| LiteTransformerSearch: Training-free Neural Architecture Search for Efficient Language Models | Mar 4, 2022 | DecoderGPU | CodeCode Available | 2 |
| Contextual Semantic Embeddings for Ontology Subsumption Prediction | Feb 20, 2022 | Knowledge Graph EmbeddingsLanguage Modeling | CodeCode Available | 2 |
| Online Decision Transformer | Feb 11, 2022 | D4RLEfficient Exploration | CodeCode Available | 2 |
| ProteinBERT: a universal deep-learning model of protein sequence and function | Feb 10, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| TimeLMs: Diachronic Language Models from Twitter | Feb 8, 2022 | Continual LearningLanguage Modeling | CodeCode Available | 2 |
| Cedille: A large autoregressive French language model | Feb 7, 2022 | Few-Shot LearningLanguage Modeling | CodeCode Available | 2 |
| Pre-Trained Language Models for Interactive Decision-Making | Feb 3, 2022 | Decision MakingImitation Learning | CodeCode Available | 2 |
| Formal Mathematics Statement Curriculum Learning | Feb 3, 2022 | Automated Theorem ProvingLanguage Modeling | CodeCode Available | 2 |
| Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval | Jan 28, 2022 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
| Synchromesh: Reliable code generation from pre-trained language models | Jan 26, 2022 | Code GenerationLanguage Modeling | CodeCode Available | 2 |
| Black-Box Tuning for Language-Model-as-a-Service | Jan 10, 2022 | In-Context LearningLanguage Modeling | CodeCode Available | 2 |
| Scaling Language Models: Methods, Analysis & Insights from Training Gopher | Dec 8, 2021 | Abstract AlgebraAnachronisms | CodeCode Available | 2 |
| ClipCap: CLIP Prefix for Image Captioning | Nov 18, 2021 | Image CaptioningLanguage Modeling | CodeCode Available | 2 |
| DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing | Nov 18, 2021 | Language ModelingLanguage Modelling | CodeCode Available | 2 |
