Question Generation
The goal of Question Generation is to generate a valid and fluent question according to a given passage and the target answer. Question Generation can be used in many scenarios, such as automatic tutoring systems, improving the performance of Question Answering models and enabling chatbots to lead a conversation.
Papers
No papers found.
All datasetsSQuAD1.1COCO Visual Question Answering (VQA) real images 1.0 open endedGrailQA-CompositionalGrailQA-IIDGrailQA-Zero-ShotFairytaleQAWeiboPollsNatural QuestionsSQuADTriviaQAVisual Question Generation
Benchmark Results
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | ERNIE-GENLARGE (beam size=5) | BLEU-4 | 25.41 | — | Unverified |
| 2 | BART (TextBox 2.0) | BLEU-4 | 25.08 | — | Unverified |
| 3 | ProphetNet + ASGen | BLEU-4 | 24.44 | — | Unverified |
| 4 | UniLMv2 | BLEU-4 | 24.43 | — | Unverified |
| 5 | ProphetNet + syn. mask + localness | BLEU-4 | 24.37 | — | Unverified |
| 6 | ProphetNet | BLEU-4 | 23.91 | — | Unverified |
| 7 | UniLM + ASGen | BLEU-4 | 23.7 | — | Unverified |
| 8 | UniLM | BLEU-4 | 22.78 | — | Unverified |
| 9 | BERTSQG | BLEU-4 | 22.17 | — | Unverified |
| 10 | Selector & NQG++ | BLEU-4 | 15.87 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MDN | BLEU-1 | 65.1 | — | Unverified |
| 2 | coco-Caption [[Karpathy and Li2014]] | BLEU-1 | 62.5 | — | Unverified |
| 3 | Max(Yang,2015) | BLEU-1 | 59.4 | — | Unverified |
| 4 | Sample(Yang,2015) | BLEU-1 | 38.8 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | BART fine-tuned on FairytaleQA | ROUGE-L | 0.53 | — | Unverified |
| 2 | BART fine-tuned on NarrativeQA and FairytaleQA | ROUGE-L | 0.52 | — | Unverified |
| 3 | BART fine-tuned on NarrativeQA | ROUGE-L | 0.44 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Info-HCVAE | QAE | 37.18 | — | Unverified |
| 2 | HCVAE | QAE | 31.45 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Info-HCVAE | QAE | 71.18 | — | Unverified |
| 2 | HCVAE | QAE | 69.46 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | Info-HCVAE | QAE | 35.45 | — | Unverified |
| 2 | HCVAE | QAE | 30.2 | — | Unverified |
| # | Model | Metric | Claimed | Verified | Status |
|---|---|---|---|---|---|
| 1 | MDN | BLEU-1 | 36 | — | Unverified |