SOTAVerified

Question Generation

The goal of Question Generation is to generate a valid and fluent question according to a given passage and the target answer. Question Generation can be used in many scenarios, such as automatic tutoring systems, improving the performance of Question Answering models and enabling chatbots to lead a conversation.

Source: Generating Highly Relevant Questions

Papers

Showing 150 of 664 papers

TitleStatusHype
Infinity-MM: Scaling Multimodal Performance with Large-Scale and High-Quality Instruction DataCode7
TRUE: Re-evaluating Factual Consistency EvaluationCode4
TextBox 2.0: A Text Generation Library with Pre-trained Language ModelsCode3
All You May Need for VQA are Image CaptionsCode3
Learning Dense Representations of Phrases at ScaleCode2
Simplifying Paragraph-level Question Generation via Transformer Language ModelsCode2
Exploring the Limits of Transfer Learning with a Unified Text-to-Text TransformerCode2
Synthetic QA Corpora Generation with Roundtrip ConsistencyCode2
Bench4KE: Benchmarking Automated Competency Question GenerationCode1
HerO at AVeriTeC: The Herd of Open Large Language Models for Verifying Real-World ClaimsCode1
What are the Essential Factors in Crafting Effective Long Context Multi-Hop Instruction Datasets? Insights and Best PracticesCode1
QGEval: Benchmarking Multi-dimensional Evaluation for Question GenerationCode1
Towards Better Question Generation in QA-based Event ExtractionCode1
Which questions should I answer? Salience Prediction of Inquisitive QuestionsCode1
PhD: A ChatGPT-Prompted Visual hallucination Evaluation DatasetCode1
Qsnail: A Questionnaire Dataset for Sequential Question GenerationCode1
Q&A Prompts: Discovering Rich Visual Clues through Mining Question-Answer Prompts for VQA requiring Diverse World KnowledgeCode1
DBCopilot: Natural Language Querying over Massive Databases via Schema RoutingCode1
TeleQnA: A Benchmark Dataset to Assess Large Language Models Telecommunications KnowledgeCode1
Diversify Question Generation with Retrieval-Augmented Style TransferCode1
Open-source Large Language Models are Strong Zero-shot Query Likelihood Models for Document RankingCode1
Improving Question Generation with Multi-level Content PlanningCode1
MinPrompt: Graph-based Minimal Prompt Data Augmentation for Few-shot Question AnsweringCode1
VDC: Versatile Data Cleanser based on Visual-Linguistic Inconsistency by Multimodal Large Language ModelsCode1
Spider4SPARQL: A Complex Benchmark for Evaluating Knowledge Graph Question Answering SystemsCode1
Event Extraction as Question Generation and AnsweringCode1
What You See is What You Read? Improving Text-Image Alignment EvaluationCode1
TESS: Text-to-Text Self-Conditioned Simplex DiffusionCode1
Modeling What-to-ask and How-to-ask for Answer-unaware Conversational Question GenerationCode1
kNN-BOX: A Unified Framework for Nearest Neighbor GenerationCode1
ClarifyDelphi: Reinforced Clarification Questions with Defeasibility Rewards for Social and Moral SituationsCode1
Automatic Generation of Socratic Subquestions for Teaching Math Word ProblemsCode1
Collaborative and AI-aided Exam Question Generation using Wikidata in EducationCode1
RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the QuestionCode1
PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in FinanceCode1
EduQG: A Multi-format Multiple Choice Dataset for the Educational DomainCode1
CoHS-CQG: Context and History Selection for Conversational Question GenerationCode1
Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question AnsweringCode1
Joint Generator-Ranker Learning for Natural Language GenerationCode1
EAGER: Asking and Answering Questions for Automatic Reward Shaping in Language-guided RLCode1
Learning to Ask Like a PhysicianCode1
Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit PostsCode1
Learning to Answer Visual Questions from Web VideosCode1
A Taxonomy of Empathetic Questions in Social DialogsCode1
CQG: A Simple and Effective Controlled Generation Framework for Multi-hop Question GenerationCode1
A Feasibility Study of Answer-Unaware Question Generation for EducationCode1
Towards Process-Oriented, Modular, and Versatile Question Generation that Meets Educational NeedsCode1
Improving Passage Retrieval with Zero-Shot Question GenerationCode1
Educational Question Generation of Children Storybooks via Question Type Distribution Learning and Event-Centric SummarizationCode1
Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative ComprehensionCode1
Show:102550
← PrevPage 1 of 14Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1ERNIE-GENLARGE (beam size=5)BLEU-425.41Unverified
2BART (TextBox 2.0)BLEU-425.08Unverified
3ProphetNet + ASGenBLEU-424.44Unverified
4UniLMv2BLEU-424.43Unverified
5ProphetNet + syn. mask + localnessBLEU-424.37Unverified
6ProphetNetBLEU-423.91Unverified
7UniLM + ASGenBLEU-423.7Unverified
8UniLMBLEU-422.78Unverified
9BERTSQGBLEU-422.17Unverified
10Selector & NQG++BLEU-415.87Unverified
#ModelMetricClaimedVerifiedStatus
1MDNBLEU-165.1Unverified
2coco-Caption [[Karpathy and Li2014]]BLEU-162.5Unverified
3Max(Yang,2015)BLEU-159.4Unverified
4Sample(Yang,2015)BLEU-138.8Unverified
#ModelMetricClaimedVerifiedStatus
1FactJointGTMETEOR36.21Unverified
2JointGTMETEOR36.08Unverified
3FactT5BMETEOR35.72Unverified
4T5BMETEOR35.64Unverified
#ModelMetricClaimedVerifiedStatus
1FactT5BBLEU46.1Unverified
2JointGTBLEU45.95Unverified
3T5BBLEU44.51Unverified
4FactJointGTBLEU43.61Unverified
#ModelMetricClaimedVerifiedStatus
1JointGTMETEOR37.69Unverified
2FactJointGTMETEOR37.55Unverified
3FactT5BMETEOR37.39Unverified
4T5BMETEOR37.35Unverified
#ModelMetricClaimedVerifiedStatus
1BART fine-tuned on FairytaleQAROUGE-L0.53Unverified
2BART fine-tuned on NarrativeQA and FairytaleQAROUGE-L0.52Unverified
3BART fine-tuned on NarrativeQAROUGE-L0.44Unverified
#ModelMetricClaimedVerifiedStatus
1UniPollROUGE-149.6Unverified
2T5ROUGE-144.46Unverified
3Dual DecROUGE-138.24Unverified
#ModelMetricClaimedVerifiedStatus
1Info-HCVAEQAE37.18Unverified
2HCVAEQAE31.45Unverified
#ModelMetricClaimedVerifiedStatus
1Info-HCVAEQAE71.18Unverified
2HCVAEQAE69.46Unverified
#ModelMetricClaimedVerifiedStatus
1Info-HCVAEQAE35.45Unverified
2HCVAEQAE30.2Unverified
#ModelMetricClaimedVerifiedStatus
1MDNBLEU-136Unverified