SOTAVerified

Video Generation

( Various Video Generation Tasks. Gif credit: MaGViT )

Papers

Showing 12511300 of 1466 papers

TitleStatusHype
GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation0
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large DatasetsCode0
AdaDiff: Adaptive Step Selection for Fast Diffusion Models0
Decouple Content and Motion for Conditional Image-to-Video Generation0
GPT4Motion: Scripting Physical Motions in Text-to-Video Generation via Blender-Oriented GPT Planning0
MoVideo: Motion-Aware Video Generation with Diffusion Models0
Make Pixels Dance: High-Dynamic Video Generation0
Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioning0
LLM as an Art Director (LaDi): Using LLMs to improve Text-to-Media Generators0
MeVGAN: GAN-based Plugin Model for Video Generation with Applications in ColonoscopyCode0
REGIS: Refining Generated Videos via Iterative Stylistic RedesigningCode0
POS: A Prompts Optimization Suite for Augmenting Text-to-Video Generation0
VideoDreamer: Customized Multi-Subject Text-to-Video Generation with Disen-Mix Finetuning0
Exploring the Hyperparameter Space of Image Diffusion Models for Echocardiogram Generation0
The Missing U for Efficient Diffusion Models0
Echocardiography video synthesis from end diastolic semantic map via diffusion model0
RT-GAN: Recurrent Temporal GAN for Adding Lightweight Temporal Consistency to Frame-Based Domain Translation Approaches0
LLM-grounded Video Diffusion Models0
OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions0
VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning0
GLOBER: Coherent Non-autoregressive Video Generation via GLOBal Guided Video DecodERCode0
The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion0
RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model0
VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation0
Explaining Vision and Language through Graphs of Events in Space and Time0
MagicAvatar: Multimodal Avatar Generation and Animation0
Dysen-VDM: Empowering Dynamics-aware Text-to-Video Diffusion with LLMs0
APLA: Additional Perturbation for Latent Noise with Adversarial Training Enables Consistency0
Hamiltonian GAN0
SimDA: Simple Diffusion Adapter for Efficient Video Generation0
Dual-Stream Diffusion Net for Text-to-Video Generation0
MobileVidFactory: Automatic Diffusion-Based Social Media Video Generation for Mobile Devices from Text0
Hierarchical Semantic Perceptual Listener Head Video Generation: A High-performance Pipeline0
InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generation0
GD-VDM: Generated Depth for better Diffusion-based Video GenerationCode0
Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis0
Quantifying Sample Anonymity in Score-Based Generative Models with Adversarial Fingerprinting0
Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance0
Preserve Your Own Correlation: A Noise Prior for Video Diffusion Models0
Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation0
Make-A-Protagonist: Generic Video Editing with An Ensemble of Experts0
Multi-object Video Generation from Single Frame Layouts0
StyleLipSync: Style-based Personalized Lip-sync Video Generation0
LaMD: Latent Motion Diffusion for Image-Conditional Video Generation0
High-Fidelity and Freely Controllable Talking Head Video Generation0
Latent-Shift: Latent Diffusion with Temporal Shift for Efficient Text-to-Video Generation0
Video Generation Beyond a Single Clip0
VidStyleODE: Disentangled Video Editing via StyleGAN and NeuralODEs0
Sounding Video Generator: A Unified Framework for Text-guided Sounding Video GenerationCode0
Qualitative Failures of Image Generation Models and Their Application in Detecting Deepfakes0
Show:102550
← PrevPage 26 of 30Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1MCVDFVD162,460Unverified
2VDMFVD161,396Unverified
3TGAN-v2 (128x128)FVD161,209Unverified
4MCVD (64x64)FVD161,143Unverified
5MoCoGAN-HD (256x256, unconditional)FVD16700Unverified
6MagicVideo (256x256, text-conditional)FVD16699Unverified
7TATS (256x256)FVD16635Unverified
8FIFO-DiffusionFVD128596.64Unverified
9DIGAN (128x128, unconditional)FVD16577Unverified
10LVDM (256x256, unconditional)FVD16552Unverified
#ModelMetricClaimedVerifiedStatus
1MoCoGANFVD score503Unverified
2Baseline (from LVT)FVD score320.9Unverified
3SVG-FP (from FVD)FVD score315.5Unverified
4CDNA (from FVD)FVD score296.5Unverified
5SV2P (from FVD)FVD score262.5Unverified
6SVG-LP (from vRNN)FVD score256.62Unverified
7WAMFVD score159.6Unverified
8VRNN 1LFVD score149.22Unverified
9SAVP (from vRNN)FVD score143.43Unverified
10Hier-VRNNFVD score143.4Unverified
#ModelMetricClaimedVerifiedStatus
1MoCoGAN-HD (128x128)FVD 16183.6Unverified
2TATS (128x128)FVD 16132.6Unverified
3Long-video GAN (256x256)FVD 16116.5Unverified
4DIGAN (128x128)FVD 16114.6Unverified
5Long-video GAN (128x128)FVD 16107.5Unverified
6LVDM (256x256)FVD 1695.2Unverified
7DDMIFVD 1666.25Unverified
8Latte + LeanVAEFVD 1649.59Unverified
9StyleSV (256x256)FVD 1649Unverified
#ModelMetricClaimedVerifiedStatus
1Video Diffusion ModelInception Score57Unverified
2TGAN-ODEInception Score15.2Unverified
3TGAN-FInception Score13.62Unverified
4MoCoGANInception Score12.42Unverified
5MoCoGAN-MDPInception Score11.86Unverified
6TGAN-SVCInception Score11.85Unverified
7VGANInception Score8.18Unverified
#ModelMetricClaimedVerifiedStatus
1TGAN-FInception Score22.91Unverified
2TGANv2Inception Score21.45Unverified
3TGANv2-ODEInception Score21.02Unverified
4MoCoGANInception Score12.42Unverified
5MoCoGAN-MDPInception Score11.86Unverified
6TGAN-SVCInception Score11.85Unverified
7VGANInception Score8.18Unverified
#ModelMetricClaimedVerifiedStatus
1Imagen original (constant=6)CLIP R-Precision92.12Unverified
2Imagen fully distilled (oscillate (15,1))CLIP R-Precision90.97Unverified
3Imagen distilled (constant=6)CLIP R-Precision90.88Unverified
4Imagen original (oscillate(15,1))CLIP R-Precision89.91Unverified
5Imagen fully distilled (constant=6)CLIP R-Precision89.68Unverified
6Imagen distilled (oscillate (15,1))CLIP R-Precision88.78Unverified
#ModelMetricClaimedVerifiedStatus
1DIGAN (256x256)FVD16156.7Unverified
2MoCoGAN-HD (128x128)FVD16144.7Unverified
3DIGAN (128x128)FVD16128.1Unverified
4LVDM (256x256)FVD1699Unverified
5TATS (128x128)FVD1694.6Unverified
6StyleSV (256x256)FVD1682.6Unverified
#ModelMetricClaimedVerifiedStatus
1TGANv2 (2020)Inception Score28.87Unverified
2DVD-GANInception Score27.38Unverified
3VideoGPTInception Score24.69Unverified
4TGANv2Inception Score24.34Unverified
5TGAN-FInception Score22.91Unverified
6TGANv2-ODEInception Score21.02Unverified
#ModelMetricClaimedVerifiedStatus
1DVD-GANFVD31.1Unverified
2MAGVITFVD9.9Unverified
#ModelMetricClaimedVerifiedStatus
1INR-VFVD16144Unverified
#ModelMetricClaimedVerifiedStatus
1DVD-GANFID2.16Unverified
#ModelMetricClaimedVerifiedStatus
1DVD-GANFID12.92Unverified
#ModelMetricClaimedVerifiedStatus
1DiT-XL/2 + CVAE-FT-SEFID8.59Unverified
#ModelMetricClaimedVerifiedStatus
1VideoAssembler (Zero-Shot, 256x256, class-conditional)FVD16252Unverified
#ModelMetricClaimedVerifiedStatus
1PG-SWGAN-3DFID404.1Unverified
#ModelMetricClaimedVerifiedStatus
1StyleSVFVD16207.2Unverified