SOTAVerified

Visual Storytelling

( Image credit: No Metrics Are Perfect )

Papers

Showing 150 of 115 papers

TitleStatusHype
Intelligent Grimm - Open-ended Visual Storytelling via Latent Diffusion ModelsCode3
FlipSketch: Flipping Static Drawings to Text-Guided Sketch AnimationsCode3
Animate-A-Story: Storytelling with Retrieval-Augmented Video GenerationCode2
Alfie: Democratising RGBA Image Generation With No $Code2
Intelligent Grimm -- Open-ended Visual Storytelling via Latent Diffusion ModelsCode2
CoMM: A Coherent Interleaved Image-Text Dataset for Multimodal Understanding and GenerationCode2
Plot and Rework: Modeling Storylines for Visual StorytellingCode1
Positional Diffusion: Ordering Unordered Sets with Diffusion Probabilistic ModelsCode1
TouchStone: Evaluating Vision-Language Models by Language ModelsCode1
Openstory++: A Large-scale Dataset and Benchmark for Instance-aware Open-domain Visual StorytellingCode1
Gorgeous: Create Your Desired Character Facial Makeup from Any IdeasCode1
inkn'hue: Enhancing Manga Colorization from Multiple Priors with Alignment Multi-Encoder VAECode1
Expressive Scene Graph Generation Using Commonsense Knowledge Infusion for Visual Understanding and ReasoningCode1
StoryReasoning Dataset: Using Chain-of-Thought for Scene Understanding and Grounded Story GenerationCode1
GROOViST: A Metric for Grounding Objects in Visual StorytellingCode0
Not (yet) the whole story: Evaluating Visual Storytelling Requires More than Measuring Coherence, Grounding, and RepetitionCode0
Contextualize, Show and Tell: A Neural Visual StorytellerCode0
Detecting and Grounding Important Characters in Visual StoriesCode0
What Makes A Good Story? Designing Composite Rewards for Visual StorytellingCode0
Visual Transformation TellingCode0
ContextualStory: Consistent Visual Storytelling with Spatially-Enhanced and Storyline ContextCode0
RoViST:Learning Robust Metrics for Visual StorytellingCode0
RoViST: Learning Robust Metrics for Visual StorytellingCode0
Consistent Story Generation with Asymmetry Zigzag SamplingCode0
Visual StorytellingCode0
Multimodal Large Language Models and Tunings: Vision, Language, Sensors, Audio, and BeyondCode0
No Metrics Are Perfect: Adversarial Reward Learning for Visual StorytellingCode0
Discourse Parsing in Videos: A Multi-modal AppraochCode0
GLAC Net: GLocal Attention Cascading Networks for Multi-image Cued Story GenerationCode0
Envisioning Narrative Intelligence: A Creative Visual Storytelling AnthologyCode0
Knowledgeable Storyteller: A Commonsense-Driven Generative Model for Visual StorytellingCode0
Knowledge-Enriched Visual StorytellingCode0
Informative Visual Storytelling with Cross-modal RulesCode0
FLIP Reasoning ChallengeCode0
AESOP: Abstract Encoding of Stories, Objects, and PicturesCode0
Learning to Rank Visual Stories From Human Ranking DataCode0
Visual Story Post-EditingCode0
Dixit: Interactive Visual Storytelling via Term Manipulation0
Camera Trajectory Generation: A Comprehensive Survey of Methods, Metrics, and Future Directions0
Diverse and Relevant Visual Storytelling with Scene Graph Embeddings0
Discourse Analysis for Evaluating Coherence in Video Paragraph Captions0
Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Tasks0
DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention0
DiffuVST: Narrating Fictional Scenes with Global-History-Guided Denoising Models0
BERT-hLSTMs: BERT and Hierarchical LSTMs for Visual Storytelling0
Induction and Reference of Entities in a Visual Story0
Incorporating Textual Evidence in Visual Storytelling0
Improving Visual Storytelling with Multimodal Large Language Models0
DANTE-AD: Dual-Vision Attention Network for Long-Term Audio Description0
A System for Image Understanding using Sensemaking and Narrative0
Show:102550
← PrevPage 1 of 3Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1GLAC NetMETEOR30.14Unverified
2HEGRBLEU-416.7Unverified
3HBSGBLEU-415.4Unverified
4IRWBLEU-415.4Unverified
5CoVSBLEU-415.2Unverified
6SGEmbBLEU-414.8Unverified
7SentiStoryBLEU-414.8Unverified
8SGVSTBLEU-414.7Unverified
9INetBLEU-414.7Unverified
10TAVST (RL)BLEU-414.6Unverified