| Exploring Length Generalization in Large Language Models | Jul 11, 2022 | Automated Theorem ProvingIn-Context Learning | —Unverified | 0 |
| TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Second | Jul 5, 2022 | AutoMLBayesian Inference | CodeCode Available | 5 |
| Rationale-Augmented Ensembles in Language Models | Jul 2, 2022 | In-Context LearningPrompt Engineering | —Unverified | 0 |
| Self-Generated In-Context Learning: Leveraging Auto-regressive Language Models as a Demonstration Generator | Jun 16, 2022 | In-Context Learningtext-classification | —Unverified | 0 |
| Language Models are General-Purpose Interfaces | Jun 13, 2022 | Causal Language ModelingFew-Shot Learning | —Unverified | 0 |
| Automatic Short Math Answer Grading via In-context Meta-learning | May 30, 2022 | automatic short answer gradingIn-Context Learning | CodeCode Available | 0 |
| Can Foundation Models Help Us Achieve Perfect Secrecy? | May 27, 2022 | Federated LearningIn-Context Learning | CodeCode Available | 1 |
| Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations | May 25, 2022 | In-Context LearningLanguage Modeling | —Unverified | 0 |
| Evaluating the Impact of Model Scale for Compositional Generalization in Semantic Parsing | May 24, 2022 | DecoderIn-Context Learning | —Unverified | 0 |
| Instruction Induction: From Few Examples to Natural Language Task Descriptions | May 22, 2022 | In-Context Learning | CodeCode Available | 1 |
| Prototypical Calibration for Few-shot Learning of Language Models | May 20, 2022 | Few-Shot LearningIn-Context Learning | CodeCode Available | 0 |
| Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning | May 11, 2022 | Few-Shot Text ClassificationIn-Context Learning | CodeCode Available | 4 |
| UL2: Unifying Language Learning Paradigms | May 10, 2022 | Arithmetic ReasoningCommon Sense Reasoning | CodeCode Available | 1 |
| The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning | May 6, 2022 | In-Context LearningLanguage Modelling | CodeCode Available | 1 |
| Contrastive Learning for Prompt-Based Few-Shot Language Learners | May 3, 2022 | Contrastive LearningIn-Context Learning | CodeCode Available | 1 |
| Exploiting Language Model Prompts Using Similarity Measures: A Case Study on the Word-in-Context Task | May 1, 2022 | Few-Shot LearningIn-Context Learning | —Unverified | 0 |
| What Makes Good In-Context Examples for GPT-3? | May 1, 2022 | In-Context LearningNatural Language Understanding | —Unverified | 0 |
| On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model | Apr 28, 2022 | Few-Shot LearningIn-Context Learning | —Unverified | 0 |
| Super-Prompting: Utilizing Model-Independent Contextual Data to Reduce Data Annotation Required in Visual Commonsense Tasks | Apr 25, 2022 | Few-Shot LearningIn-Context Learning | —Unverified | 0 |
| Data Distributional Properties Drive Emergent In-Context Learning in Transformers | Apr 22, 2022 | Few-Shot LearningIn-Context Learning | CodeCode Available | 1 |
| Can language models learn from explanations in context? | Apr 5, 2022 | In-Context Learning | —Unverified | 0 |
| Leveraging pre-trained language models for conversational information seeking from text | Mar 31, 2022 | Few-Shot LearningIn-Context Learning | —Unverified | 0 |
| In-Context Learning for Few-Shot Dialogue State Tracking | Mar 16, 2022 | Dialogue State TrackingFew-Shot Learning | CodeCode Available | 1 |
| Thinking about GPT-3 In-Context Learning for Biomedical IE? Think Again | Mar 16, 2022 | In-Context LearningModel Selection | CodeCode Available | 1 |
| Efficient Language Modeling with Sparse all-MLP | Mar 14, 2022 | AllCommon Sense Reasoning | —Unverified | 0 |
| Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? | Feb 25, 2022 | In-Context Learning | CodeCode Available | 1 |
| Semantic-Oriented Unlabeled Priming for Large-Scale Language Models | Feb 12, 2022 | In-Context Learning | —Unverified | 0 |
| MetaICL: Learning to Learn In Context | Jan 16, 2022 | Few-Shot LearningIn-Context Learning | —Unverified | 0 |
| Exploring Example Selection for Few-shot Text-to-SQL Semantic Parsing | Jan 16, 2022 | Few-Shot LearningIn-Context Learning | —Unverified | 0 |
| Learning To Retrieve Prompts for In-Context Learning | Jan 16, 2022 | In-Context LearningLanguage Modeling | —Unverified | 0 |
| Black-Box Tuning for Language-Model-as-a-Service | Jan 10, 2022 | In-Context LearningLanguage Modeling | CodeCode Available | 2 |
| Transformers Can Do Bayesian Inference | Dec 20, 2021 | AutoMLBayesian Inference | CodeCode Available | 1 |
| Learning To Retrieve Prompts for In-Context Learning | Dec 16, 2021 | In-Context LearningLanguage Modeling | CodeCode Available | 1 |
| GLaM: Efficient Scaling of Language Models with Mixture-of-Experts | Dec 13, 2021 | Common Sense ReasoningIn-Context Learning | —Unverified | 0 |
| MAGMA -- Multimodal Augmentation of Generative Models through Adapter-based Finetuning | Dec 9, 2021 | In-Context LearningLanguage Modeling | CodeCode Available | 1 |
| Semantic-Oriented Unlabeled Priming for Large-Scale Language Models | Nov 16, 2021 | In-Context Learning | —Unverified | 0 |
| Meta-learning via Language Model In-context Tuning | Nov 16, 2021 | In-Context LearningInductive Bias | —Unverified | 0 |
| Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER | Nov 16, 2021 | Domain AdaptationFew-Shot Text Classification | —Unverified | 0 |
| An Explanation of In-context Learning as Implicit Bayesian Inference | Nov 3, 2021 | Few-Shot LearningIn-Context Learning | CodeCode Available | 1 |
| MetaICL: Learning to Learn In Context | Oct 29, 2021 | Few-Shot LearningIn-Context Learning | CodeCode Available | 1 |
| It's my Job to be Repetitive! My Job! My Job! -- Linking Repetitions to In-Context Learning in Language Models | Oct 16, 2021 | In-Context Learning | —Unverified | 0 |
| Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER | Oct 16, 2021 | Domain AdaptationFew-Shot Text Classification | CodeCode Available | 1 |
| Meta-learning via Language Model In-context Tuning | Oct 15, 2021 | In-Context LearningInductive Bias | CodeCode Available | 1 |
| LiST: Lite Prompted Self-training Makes Parameter-Efficient Few-shot Learners | Oct 12, 2021 | Few-Shot LearningIn-Context Learning | CodeCode Available | 1 |
| The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design | Oct 9, 2021 | ChunkingIn-Context Learning | —Unverified | 0 |
| What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers | Sep 10, 2021 | Few-Shot LearningIn-Context Learning | CodeCode Available | 2 |
| PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation | Apr 26, 2021 | Cloze (multi-choices) (Few-Shot)Cloze (multi-choices) (One-Shot) | CodeCode Available | 1 |
