SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Showing 151200 of 282 papers

TitleStatusHype
Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation0
Broadband Ground Motion Synthesis via Generative Adversarial Neural Operators: Development and ValidationCode1
MCM: Multi-condition Motion Synthesis Framework for Multi-scenarioCode1
DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion0
AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention MechanismCode1
InterDiff: Generating 3D Human-Object Interactions with Physics-Informed DiffusionCode2
ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors0
Language-guided Human Motion Synthesis with Atomic ActionsCode1
A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesis0
TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis0
NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis0
Interactive Character Control with Auto-Regressive Motion Diffusion ModelsCode1
Example-based Motion Synthesis via Generative Motion MatchingCode2
Enhanced Fine-grained Motion Diffusion for Text-driven Human Motion Synthesis0
Guided Motion Diffusion for Controllable Human Motion Synthesis0
Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation0
HumanRF: High-Fidelity Neural Radiance Fields for Humans in MotionCode2
Generating Virtual On-body Accelerometer Data from Virtual Textual Descriptions for Human Activity RecognitionCode1
TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion SynthesisCode2
Motion-Conditioned Diffusion Model for Controllable Video Synthesis0
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion SynthesisCode0
InterGen: Diffusion-based Multi-human Motion Generation under Complex InteractionsCode2
TM2D: Bimodality Driven 3D Dance Generation via Music-Text IntegrationCode1
Generating Continual Human Motion in Diverse 3D Scenes0
Controllable Motion Synthesis and Reconstruction with Autoregressive Diffusion Models0
ReMoDiffuse: Retrieval-Augmented Motion Diffusion ModelCode2
Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion InterpolationCode1
PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environments0
Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations0
Music-Driven Group ChoreographyCode1
Open-World Pose Transfer via Sequential Test-Time Adaption0
Multi-Scale Control Signal-Aware Transformer for Motion Synthesis without Phase0
Human Motion Diffusion as a Generative PriorCode2
Human MotionFormer: Transferring Human Motions with Vision TransformersCode1
T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete RepresentationsCode2
MixSynthFormer: A Transformer Encoder-like Structure with Mixed Synthetic Self-attention for Efficient Human Pose Estimation0
Breaking The Limits of Text-conditioned 3D Motion Synthesis with Elaborative Descriptions0
Role-Aware Interaction Generation from Textual DescriptionCode1
Full-Body Articulated Human-Object InteractionCode1
Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic ModelsCode1
IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object InteractionsCode1
Executing your Commands via Motion Diffusion in Latent SpaceCode2
MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis0
FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance GenerationCode1
Pretrained Diffusion Models for Unified Human Motion Synthesis0
UDE: A Unified Driving Engine for Human Motion GenerationCode1
BeLFusion: Latent Diffusion for Behavior-Driven Human Motion PredictionCode1
EDGE: Editable Dance Generation From MusicCode2
Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion ModelsCode2
Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model0
Show:102550
← PrevPage 4 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02Unverified
2Diffuion MotionFID10.21Unverified
3Text2GestureFID5.01Unverified
4TM2TFID1.5Unverified
5T2MFID1.09Unverified
6TM2D (t2m)FID1.02Unverified
7MAAFID0.77Unverified
8MotionDiffuseFID0.63Unverified
9MDMFID0.54Unverified
10MLDFID0.47Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12Unverified
2Language2PoseFID6.55Unverified
3TEMOSFID3.72Unverified
4TM2TFID3.6Unverified
5T2MFID3.02Unverified
6MotionDiffuseFID1.95Unverified
7AttT2MFID0.87Unverified
8T2M-GPT (τ = 0)FID0.74Unverified
9T2M-GPT (τ = 0.5)FID0.72Unverified
10Fg-T2MFID0.57Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42Unverified
2DanceNetFID69.13Unverified
3MoFusionFID50.31Unverified
4Lodge (DDPM)FID37.09Unverified
5AI ChoreographerFID35.35Unverified
6BailandoFID28.16Unverified
7TM2D (only motion data)FID23.94Unverified
8TM2DFID19.01Unverified
9UDEFID17.25Unverified
10Motion AnythingFID17.22Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38Unverified
2T2MFID13.77Unverified
3MDMFID9.17Unverified
4ComMDMFID7.07Unverified
5RIGFID6.78Unverified
6FreeMotionFID6.74Unverified
7InterGenFID5.92Unverified
8MoMat-MoGenFID5.67Unverified
9in2INFID5.18Unverified
10InterMaskFID5.15Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38Unverified
2MNETfid_k104.71Unverified
3EDGEfid_k94.34Unverified
4Bailandofid_k82.81Unverified
5Lodge (DDIM)fid_k50Unverified
6Lodge (DDPM)fid_k45.56Unverified
7Lodge++fid_k40.77Unverified
8DanceMosaicfid_k19.36Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27Unverified
2TEMOSFID29.26Unverified
3MDMFID23.7Unverified
4T2MFID5.48Unverified
5InterGenFID5.21Unverified
6InterMaskFID0.4Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9Unverified
2TCDiffFID42.39Unverified
3GCDFID31.16Unverified
4Scalable Group ChoreographyFID31.01Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24Unverified
2TG-completeL2Q@50.17Unverified
3SSMCTL2Q@50.14Unverified
4-interpolatorL2Q@50.11Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8Unverified
2MLDFID3.41Unverified
3T2M-GPTFID1.37Unverified
4HumanTOMATOFID1.17Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59Unverified
2AIST++Frechet Inception Distance0.57Unverified
3Dance RevolutionFrechet Inception Distance0.52Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99Unverified
2MLDAccuracy0.96Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44Unverified