SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 282 papers

TitleStatusHype
DeepPhase: Periodic Autoencoders for Learning Motion Phase ManifoldsCode5
MotionClone: Training-Free Motion Cloning for Controllable Video GenerationCode4
Human Motion Diffusion ModelCode4
MotionLCM: Real-time Controllable Motion Generation via Latent Consistency ModelCode3
AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D AvatarsCode3
MoMask: Generative Masked Modeling of 3D Human MotionsCode3
Motion Anything: Any to Motion GenerationCode3
Seamless Human Motion Composition with Blended Positional EncodingsCode3
BAD: Bidirectional Auto-regressive Diffusion for Text-to-Motion GenerationCode2
TEMOS: Generating diverse human motions from textual descriptionsCode2
VolumetricSMPL: A Neural Volumetric Body Model for Efficient Interactions, Contacts, and CollisionsCode2
Unpaired Motion Style Transfer from Video to AnimationCode2
Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic MemoryCode2
Generating Diverse and Natural 3D Human Motions From TextCode2
ReMoDiffuse: Retrieval-Augmented Motion Diffusion ModelCode2
FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head ModelsCode2
EDGE: Editable Dance Generation From MusicCode2
ParCo: Part-Coordinating Text-to-Motion SynthesisCode2
Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D ScenesCode2
Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene AffordanceCode2
Example-based Motion Synthesis via Generative Motion MatchingCode2
Robust Motion In-betweeningCode2
Human Motion Diffusion as a Generative PriorCode2
TEACH: Temporal Action Composition for 3D HumansCode2
Generative AI for Character Animation: A Comprehensive Survey of Techniques, Applications, and Future DirectionsCode2
TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion SynthesisCode2
Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance PrimitivesCode2
InterGen: Diffusion-based Multi-human Motion Generation under Complex InteractionsCode2
BAMM: Bidirectional Autoregressive Motion ModelCode2
T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete RepresentationsCode2
Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion ModelsCode2
HumanTOMATO: Text-aligned Whole-body Motion GenerationCode2
HumanRF: High-Fidelity Neural Radiance Fields for Humans in MotionCode2
in2IN: Leveraging individual Information to Generate Human INteractionsCode2
MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal ControlsCode2
Inter-X: Towards Versatile Human-Human Interaction AnalysisCode2
GANimator: Neural Motion Synthesis from a Single SequenceCode2
InterDiff: Generating 3D Human-Object Interactions with Physics-Informed DiffusionCode2
MotionDiffuse: Text-Driven Human Motion Generation with Diffusion ModelCode2
Free-T2M: Frequency Enhanced Text-to-Motion Diffusion Model With Consistency LossCode2
MotionLLaMA: A Unified Framework for Motion Synthesis and ComprehensionCode2
Motion Mamba: Efficient and Long Sequence Motion GenerationCode2
Skeleton-Aware Networks for Deep Motion RetargetingCode2
Executing your Commands via Motion Diffusion in Latent SpaceCode2
Reinforcement learning-based motion imitation for physiologically plausible musculoskeletal motor controlCode2
Bayesian Adversarial Human Motion SynthesisCode1
AnyMoLe: Any Character Motion In-betweening Leveraging Video Diffusion ModelsCode1
Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic GraphsCode1
BABEL: Bodies, Action and Behavior with English LabelsCode1
GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion GenerationCode1
Show:102550
← PrevPage 1 of 6Next →
All datasetsHumanML3DKIT Motion-LanguageAIST++InterHumanFineDanceInter-XAIOZ-GDANCELaFAN1Motion-XBRACEHumanAct12TMD

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02—Unverified
2Diffuion MotionFID10.21—Unverified
3Text2GestureFID5.01—Unverified
4TM2TFID1.5—Unverified
5T2MFID1.09—Unverified
6TM2D (t2m)FID1.02—Unverified
7MAAFID0.77—Unverified
8MotionDiffuseFID0.63—Unverified
9MDMFID0.54—Unverified
10MLDFID0.47—Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12—Unverified
2Language2PoseFID6.55—Unverified
3TEMOSFID3.72—Unverified
4TM2TFID3.6—Unverified
5T2MFID3.02—Unverified
6MotionDiffuseFID1.95—Unverified
7AttT2MFID0.87—Unverified
8T2M-GPT (τ = 0)FID0.74—Unverified
9T2M-GPT (τ = 0.5)FID0.72—Unverified
10Fg-T2MFID0.57—Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42—Unverified
2DanceNetFID69.13—Unverified
3MoFusionFID50.31—Unverified
4Lodge (DDPM)FID37.09—Unverified
5AI ChoreographerFID35.35—Unverified
6BailandoFID28.16—Unverified
7TM2D (only motion data)FID23.94—Unverified
8TM2DFID19.01—Unverified
9UDEFID17.25—Unverified
10Motion AnythingFID17.22—Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38—Unverified
2T2MFID13.77—Unverified
3MDMFID9.17—Unverified
4ComMDMFID7.07—Unverified
5RIGFID6.78—Unverified
6FreeMotionFID6.74—Unverified
7InterGenFID5.92—Unverified
8MoMat-MoGenFID5.67—Unverified
9in2INFID5.18—Unverified
10InterMaskFID5.15—Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38—Unverified
2MNETfid_k104.71—Unverified
3EDGEfid_k94.34—Unverified
4Bailandofid_k82.81—Unverified
5Lodge (DDIM)fid_k50—Unverified
6Lodge (DDPM)fid_k45.56—Unverified
7Lodge++fid_k40.77—Unverified
8DanceMosaicfid_k19.36—Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27—Unverified
2TEMOSFID29.26—Unverified
3MDMFID23.7—Unverified
4T2MFID5.48—Unverified
5InterGenFID5.21—Unverified
6InterMaskFID0.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9—Unverified
2TCDiffFID42.39—Unverified
3GCDFID31.16—Unverified
4Scalable Group ChoreographyFID31.01—Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24—Unverified
2TG-completeL2Q@50.17—Unverified
3SSMCTL2Q@50.14—Unverified
4-interpolatorL2Q@50.11—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8—Unverified
2MLDFID3.41—Unverified
3T2M-GPTFID1.37—Unverified
4HumanTOMATOFID1.17—Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59—Unverified
2AIST++Frechet Inception Distance0.57—Unverified
3Dance RevolutionFrechet Inception Distance0.52—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99—Unverified
2MLDAccuracy0.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44—Unverified