SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Showing 51–100 of 282 papers

TitleStatusHype
Length-Aware Motion Synthesis via Latent DiffusionCode1
Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion TransferCode1
MCM: Multi-condition Motion Synthesis FrameworkCode1
Driving Animatronic Robot Facial Expression From SpeechCode1
Self-Correcting Self-Consuming Loops for Generative Model TrainingCode1
Constrained Synthesis with Projected Diffusion ModelsCode1
IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity RecognitionCode1
GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion GenerationCode1
FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and EditingCode1
BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body DynamicsCode1
MMM: Generative Masked Motion ModelCode1
EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion GenerationCode1
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person InteractionsCode1
InterControl: Zero-shot Human Interaction Generation by Controlling Every JointCode1
Controllable Group Choreography using Contrastive DiffusionCode1
Point-Based Radiance Fields for Controllable Human Motion SynthesisCode1
Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic GraphsCode1
Broadband Ground Motion Synthesis via Generative Adversarial Neural Operators: Development and ValidationCode1
MCM: Multi-condition Motion Synthesis Framework for Multi-scenarioCode1
AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention MechanismCode1
Language-guided Human Motion Synthesis with Atomic ActionsCode1
Interactive Character Control with Auto-Regressive Motion Diffusion ModelsCode1
Generating Virtual On-body Accelerometer Data from Virtual Textual Descriptions for Human Activity RecognitionCode1
TM2D: Bimodality Driven 3D Dance Generation via Music-Text IntegrationCode1
Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion InterpolationCode1
Music-Driven Group ChoreographyCode1
Human MotionFormer: Transferring Human Motions with Vision TransformersCode1
Role-Aware Interaction Generation from Textual DescriptionCode1
Full-Body Articulated Human-Object InteractionCode1
Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic ModelsCode1
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object InteractionsCode1
FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance GenerationCode1
UDE: A Unified Driving Engine for Human Motion GenerationCode1
BeLFusion: Latent Diffusion for Behavior-Driven Human Motion PredictionCode1
Skeleton2Humanoid: Animating Simulated Characters for Physically-plausible Motion In-betweeningCode1
FLAME: Free-form Language-based Motion Synthesis & EditingCode1
BRACE: The Breakdancing Competition Dataset for Dance Motion SynthesisCode1
Diverse Dance Synthesis via Keyframes with Transformer ControllersCode1
TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and TextsCode1
MoDi: Unconditional Motion Synthesis from Diverse DataCode1
Learning to Brachiate via Simplified Model ImitationCode1
Adversarial Attention for Human Motion SynthesisCode1
MotionAug: Augmentation with Physical Correction for Human Motion PredictionCode1
Artemis: Articulated Neural Pets with Appearance and Motion synthesisCode1
Motion Puzzle: Arbitrary Motion Style Transfer by Body PartCode1
Motion Inbetweening via Deep Δ-InterpolatorCode1
A Brand New Dance Partner: Music-Conditioned Pluralistic Dancing Controlled by Multiple Dance GenresCode1
D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object InteractionsCode1
Multi-View Motion Synthesis via Applying Rotated Dual-Pixel Blur KernelsCode1
Generative Adversarial Graph Convolutional Networks for Human Action SynthesisCode1
Show:102550
← PrevPage 2 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02—Unverified
2Diffuion MotionFID10.21—Unverified
3Text2GestureFID5.01—Unverified
4TM2TFID1.5—Unverified
5T2MFID1.09—Unverified
6TM2D (t2m)FID1.02—Unverified
7MAAFID0.77—Unverified
8MotionDiffuseFID0.63—Unverified
9MDMFID0.54—Unverified
10MLDFID0.47—Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12—Unverified
2Language2PoseFID6.55—Unverified
3TEMOSFID3.72—Unverified
4TM2TFID3.6—Unverified
5T2MFID3.02—Unverified
6MotionDiffuseFID1.95—Unverified
7AttT2MFID0.87—Unverified
8T2M-GPT (τ = 0)FID0.74—Unverified
9T2M-GPT (τ = 0.5)FID0.72—Unverified
10Fg-T2MFID0.57—Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42—Unverified
2DanceNetFID69.13—Unverified
3MoFusionFID50.31—Unverified
4Lodge (DDPM)FID37.09—Unverified
5AI ChoreographerFID35.35—Unverified
6BailandoFID28.16—Unverified
7TM2D (only motion data)FID23.94—Unverified
8TM2DFID19.01—Unverified
9UDEFID17.25—Unverified
10Motion AnythingFID17.22—Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38—Unverified
2T2MFID13.77—Unverified
3MDMFID9.17—Unverified
4ComMDMFID7.07—Unverified
5RIGFID6.78—Unverified
6FreeMotionFID6.74—Unverified
7InterGenFID5.92—Unverified
8MoMat-MoGenFID5.67—Unverified
9in2INFID5.18—Unverified
10InterMaskFID5.15—Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38—Unverified
2MNETfid_k104.71—Unverified
3EDGEfid_k94.34—Unverified
4Bailandofid_k82.81—Unverified
5Lodge (DDIM)fid_k50—Unverified
6Lodge (DDPM)fid_k45.56—Unverified
7Lodge++fid_k40.77—Unverified
8DanceMosaicfid_k19.36—Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27—Unverified
2TEMOSFID29.26—Unverified
3MDMFID23.7—Unverified
4T2MFID5.48—Unverified
5InterGenFID5.21—Unverified
6InterMaskFID0.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9—Unverified
2TCDiffFID42.39—Unverified
3GCDFID31.16—Unverified
4Scalable Group ChoreographyFID31.01—Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24—Unverified
2TG-completeL2Q@50.17—Unverified
3SSMCTL2Q@50.14—Unverified
4-interpolatorL2Q@50.11—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8—Unverified
2MLDFID3.41—Unverified
3T2M-GPTFID1.37—Unverified
4HumanTOMATOFID1.17—Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59—Unverified
2AIST++Frechet Inception Distance0.57—Unverified
3Dance RevolutionFrechet Inception Distance0.52—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99—Unverified
2MLDAccuracy0.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44—Unverified