| Linear Attention via Orthogonal Memory | Dec 18, 2023 | Causal Language ModelingComputational Efficiency | —Unverified | 0 |
| Bootstrapping Interactive Image-Text Alignment for Remote Sensing Image Captioning | Dec 2, 2023 | Causal Language ModelingContrastive Learning | CodeCode Available | 1 |
| DavIR: Data Selection via Implicit Reward for Large Language Models | Oct 16, 2023 | Causal Language ModelingGSM8K | —Unverified | 0 |
| Is attention required for ICL? Exploring the Relationship Between Model Architecture and In-Context Learning Ability | Oct 12, 2023 | Causal Language ModelingIn-Context Learning | CodeCode Available | 0 |
| A Meta-Learning Perspective on Transformers for Causal Language Modeling | Oct 9, 2023 | Causal Language ModelingLanguage Modeling | —Unverified | 0 |
| What's the Magic Word? A Control Theory of LLM Prompting | Oct 2, 2023 | Causal Language ModelingLanguage Modeling | CodeCode Available | 1 |
| AstroLLaMA: Towards Specialized Foundation Models in Astronomy | Sep 12, 2023 | AstronomyCausal Language Modeling | —Unverified | 0 |
| CodeGen2: Lessons for Training LLMs on Programming and Natural Languages | May 3, 2023 | Causal Language ModelingDecoder | CodeCode Available | 5 |
| ProtFIM: Fill-in-Middle Protein Sequence Design via Protein Language Models | Mar 29, 2023 | Causal Language ModelingLanguage Modeling | —Unverified | 0 |
| Video Pre-trained Transformer: A Multimodal Mixture of Pre-trained Experts | Mar 24, 2023 | Causal Language ModelingLanguage Modeling | CodeCode Available | 1 |
| Cross-lingual Similarity of Multilingual Representations Revisited | Dec 4, 2022 | Causal Language ModelingCross-Lingual Transfer | CodeCode Available | 0 |
| Suffix Retrieval-Augmented Language Modeling | Nov 6, 2022 | Causal Language ModelingLanguage Modeling | CodeCode Available | 0 |
| A Simple, Yet Effective Approach to Finding Biases in Code Generation | Oct 31, 2022 | Causal Language ModelingCode Generation | —Unverified | 0 |
| A Closer Look at Parameter Contributions When Training Neural Language and Translation Models | Oct 1, 2022 | Causal Language ModelingLanguage Modeling | —Unverified | 0 |
| AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model | Aug 2, 2022 | Causal Language ModelingCommon Sense Reasoning | CodeCode Available | 2 |
| Learning from flowsheets: A generative transformer model for autocompletion of flowsheets | Aug 1, 2022 | Causal Language ModelingLanguage Modeling | —Unverified | 0 |
| Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Data | Jun 22, 2022 | Causal Language ModelingLanguage Modeling | CodeCode Available | 1 |
| Language Models are General-Purpose Interfaces | Jun 13, 2022 | Causal Language ModelingFew-Shot Learning | CodeCode Available | 0 |
| Transcormer: Transformer for Sentence Scoring with Sliding Language Modeling | May 25, 2022 | Causal Language ModelingLanguage Modeling | CodeCode Available | 1 |
| Multitask Finetuning for Improving Neural Machine Translation in Indian Languages | Dec 3, 2021 | Causal Language ModelingLanguage Modeling | —Unverified | 0 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Nov 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | —Unverified | 0 |
| Prix-LM: Pretraining for Multilingual Knowledge Base Construction | Oct 16, 2021 | Bilingual Lexicon InductionCausal Language Modeling | CodeCode Available | 0 |
| Multi-Task Learning for Situated Multi-Domain End-to-End Dialogue Systems | Oct 11, 2021 | Causal Language ModelingDiversity | —Unverified | 0 |
| IntenT5: Search Result Diversification using Causal Language Models | Aug 9, 2021 | Causal Language ModelingDiversity | —Unverified | 0 |
| Large Product Key Memory for Pretrained Language Models | Oct 8, 2020 | Causal Language ModelingLanguage Modeling | CodeCode Available | 0 |
