SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Showing 51100 of 282 papers

TitleStatusHype
Length-Aware Motion Synthesis via Latent DiffusionCode1
Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion TransferCode1
MCM: Multi-condition Motion Synthesis FrameworkCode1
Driving Animatronic Robot Facial Expression From SpeechCode1
Self-Correcting Self-Consuming Loops for Generative Model TrainingCode1
Constrained Synthesis with Projected Diffusion ModelsCode1
IMUGPT 2.0: Language-Based Cross Modality Transfer for Sensor-Based Human Activity RecognitionCode1
GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion GenerationCode1
FineMoGen: Fine-Grained Spatio-Temporal Motion Generation and EditingCode1
BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body DynamicsCode1
MMM: Generative Masked Motion ModelCode1
EMDM: Efficient Motion Diffusion Model for Fast and High-Quality Motion GenerationCode1
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person InteractionsCode1
InterControl: Zero-shot Human Interaction Generation by Controlling Every JointCode1
Controllable Group Choreography using Contrastive DiffusionCode1
Point-Based Radiance Fields for Controllable Human Motion SynthesisCode1
Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic GraphsCode1
Broadband Ground Motion Synthesis via Generative Adversarial Neural Operators: Development and ValidationCode1
MCM: Multi-condition Motion Synthesis Framework for Multi-scenarioCode1
AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention MechanismCode1
Language-guided Human Motion Synthesis with Atomic ActionsCode1
Interactive Character Control with Auto-Regressive Motion Diffusion ModelsCode1
Generating Virtual On-body Accelerometer Data from Virtual Textual Descriptions for Human Activity RecognitionCode1
TM2D: Bimodality Driven 3D Dance Generation via Music-Text IntegrationCode1
Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion InterpolationCode1
Music-Driven Group ChoreographyCode1
Human MotionFormer: Transferring Human Motions with Vision TransformersCode1
Role-Aware Interaction Generation from Textual DescriptionCode1
Full-Body Articulated Human-Object InteractionCode1
Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic ModelsCode1
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object InteractionsCode1
FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance GenerationCode1
UDE: A Unified Driving Engine for Human Motion GenerationCode1
BeLFusion: Latent Diffusion for Behavior-Driven Human Motion PredictionCode1
Skeleton2Humanoid: Animating Simulated Characters for Physically-plausible Motion In-betweeningCode1
FLAME: Free-form Language-based Motion Synthesis & EditingCode1
BRACE: The Breakdancing Competition Dataset for Dance Motion SynthesisCode1
Diverse Dance Synthesis via Keyframes with Transformer ControllersCode1
TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and TextsCode1
MoDi: Unconditional Motion Synthesis from Diverse DataCode1
Learning to Brachiate via Simplified Model ImitationCode1
Adversarial Attention for Human Motion SynthesisCode1
MotionAug: Augmentation with Physical Correction for Human Motion PredictionCode1
Artemis: Articulated Neural Pets with Appearance and Motion synthesisCode1
Motion Puzzle: Arbitrary Motion Style Transfer by Body PartCode1
Motion Inbetweening via Deep Δ-InterpolatorCode1
A Brand New Dance Partner: Music-Conditioned Pluralistic Dancing Controlled by Multiple Dance GenresCode1
D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object InteractionsCode1
Multi-View Motion Synthesis via Applying Rotated Dual-Pixel Blur KernelsCode1
Generative Adversarial Graph Convolutional Networks for Human Action SynthesisCode1
Show:102550
← PrevPage 2 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02Unverified
2Diffuion MotionFID10.21Unverified
3Text2GestureFID5.01Unverified
4TM2TFID1.5Unverified
5T2MFID1.09Unverified
6TM2D (t2m)FID1.02Unverified
7MAAFID0.77Unverified
8MotionDiffuseFID0.63Unverified
9MDMFID0.54Unverified
10MLDFID0.47Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12Unverified
2Language2PoseFID6.55Unverified
3TEMOSFID3.72Unverified
4TM2TFID3.6Unverified
5T2MFID3.02Unverified
6MotionDiffuseFID1.95Unverified
7AttT2MFID0.87Unverified
8T2M-GPT (τ = 0)FID0.74Unverified
9T2M-GPT (τ = 0.5)FID0.72Unverified
10Fg-T2MFID0.57Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42Unverified
2DanceNetFID69.13Unverified
3MoFusionFID50.31Unverified
4Lodge (DDPM)FID37.09Unverified
5AI ChoreographerFID35.35Unverified
6BailandoFID28.16Unverified
7TM2D (only motion data)FID23.94Unverified
8TM2DFID19.01Unverified
9UDEFID17.25Unverified
10Motion AnythingFID17.22Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38Unverified
2T2MFID13.77Unverified
3MDMFID9.17Unverified
4ComMDMFID7.07Unverified
5RIGFID6.78Unverified
6FreeMotionFID6.74Unverified
7InterGenFID5.92Unverified
8MoMat-MoGenFID5.67Unverified
9in2INFID5.18Unverified
10InterMaskFID5.15Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38Unverified
2MNETfid_k104.71Unverified
3EDGEfid_k94.34Unverified
4Bailandofid_k82.81Unverified
5Lodge (DDIM)fid_k50Unverified
6Lodge (DDPM)fid_k45.56Unverified
7Lodge++fid_k40.77Unverified
8DanceMosaicfid_k19.36Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27Unverified
2TEMOSFID29.26Unverified
3MDMFID23.7Unverified
4T2MFID5.48Unverified
5InterGenFID5.21Unverified
6InterMaskFID0.4Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9Unverified
2TCDiffFID42.39Unverified
3GCDFID31.16Unverified
4Scalable Group ChoreographyFID31.01Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24Unverified
2TG-completeL2Q@50.17Unverified
3SSMCTL2Q@50.14Unverified
4-interpolatorL2Q@50.11Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8Unverified
2MLDFID3.41Unverified
3T2M-GPTFID1.37Unverified
4HumanTOMATOFID1.17Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59Unverified
2AIST++Frechet Inception Distance0.57Unverified
3Dance RevolutionFrechet Inception Distance0.52Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99Unverified
2MLDAccuracy0.96Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44Unverified