SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Showing 201250 of 282 papers

TitleStatusHype
Move as You Say Interact as You Can: Language-guided Human Motion Generation with Scene Affordance0
Probabilistic Speech-Driven 3D Facial Motion Synthesis: New Benchmarks Methods and Applications0
MACS: Mass Conditioned 3D Hand and Object Motion Synthesis0
Ponymation: Learning 3D Animal Motions from Unlabeled Online Videos0
MotionScript: Natural Language Descriptions for Expressive 3D Human Motions0
Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model0
Motion Flow Matching for Human Motion Synthesis and Editing0
Digital Life Project: Autonomous 3D Characters with Social Intelligence0
AAMDM: Accelerated Auto-regressive Motion Diffusion Model0
OmniMotionGPT: Animal Motion Generation with Limited Data0
Probabilistic Speech-Driven 3D Facial Motion Synthesis: New Benchmarks, Methods, and Applications0
TLControl: Trajectory and Language Control for Human Motion Synthesis0
AvatarGPT: All-in-One Framework for Motion Understanding, Planning, Generation and Beyond0
A Unified Framework for Multimodal, Multi-Part Human Motion Synthesis0
PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics0
Story-to-Motion: Synthesizing Infinite and Controllable Character Animation from Long Text0
Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior0
On the Benefit of Generative Foundation Models for Human Activity Recognition0
Unified speech and gesture synthesis using flow matching0
Object Motion Guided Human Motion Synthesis0
DROP: Dynamics Responses from Human Motion Prior and Projective Dynamics0
Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Model0
Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation0
DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion0
ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors0
A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesis0
TEDi: Temporally-Entangled Diffusion for Long-Term Motion Synthesis0
NIFTY: Neural Object Interaction Fields for Guided Human Motion Synthesis0
Enhanced Fine-grained Motion Diffusion for Text-driven Human Motion Synthesis0
Guided Motion Diffusion for Controllable Human Motion Synthesis0
Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation0
Motion-Conditioned Diffusion Model for Controllable Video Synthesis0
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion SynthesisCode0
Generating Continual Human Motion in Diverse 3D Scenes0
Controllable Motion Synthesis and Reconstruction with Autoregressive Diffusion Models0
PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environments0
Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations0
Open-World Pose Transfer via Sequential Test-Time Adaption0
Multi-Scale Control Signal-Aware Transformer for Motion Synthesis without Phase0
MixSynthFormer: A Transformer Encoder-like Structure with Mixed Synthetic Self-attention for Efficient Human Pose Estimation0
Breaking The Limits of Text-conditioned 3D Motion Synthesis with Elaborative Descriptions0
MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesis0
Pretrained Diffusion Models for Unified Human Motion Synthesis0
Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model0
KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance ArtCode0
Denoising Diffusion Probabilistic Models for Styled Walking Synthesis0
NEURAL MARIONETTE: A Transformer-based Multi-action Human Motion Synthesis System0
Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes0
Music-driven Dance Regeneration with Controllable Key Pose Constraints0
Recurrent Transformer Variational Autoencoders for Multi-Action Motion SynthesisCode0
Show:102550
← PrevPage 5 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02Unverified
2Diffuion MotionFID10.21Unverified
3Text2GestureFID5.01Unverified
4TM2TFID1.5Unverified
5T2MFID1.09Unverified
6TM2D (t2m)FID1.02Unverified
7MAAFID0.77Unverified
8MotionDiffuseFID0.63Unverified
9MDMFID0.54Unverified
10MLDFID0.47Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12Unverified
2Language2PoseFID6.55Unverified
3TEMOSFID3.72Unverified
4TM2TFID3.6Unverified
5T2MFID3.02Unverified
6MotionDiffuseFID1.95Unverified
7AttT2MFID0.87Unverified
8T2M-GPT (τ = 0)FID0.74Unverified
9T2M-GPT (τ = 0.5)FID0.72Unverified
10Fg-T2MFID0.57Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42Unverified
2DanceNetFID69.13Unverified
3MoFusionFID50.31Unverified
4Lodge (DDPM)FID37.09Unverified
5AI ChoreographerFID35.35Unverified
6BailandoFID28.16Unverified
7TM2D (only motion data)FID23.94Unverified
8TM2DFID19.01Unverified
9UDEFID17.25Unverified
10Motion AnythingFID17.22Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38Unverified
2T2MFID13.77Unverified
3MDMFID9.17Unverified
4ComMDMFID7.07Unverified
5RIGFID6.78Unverified
6FreeMotionFID6.74Unverified
7InterGenFID5.92Unverified
8MoMat-MoGenFID5.67Unverified
9in2INFID5.18Unverified
10InterMaskFID5.15Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38Unverified
2MNETfid_k104.71Unverified
3EDGEfid_k94.34Unverified
4Bailandofid_k82.81Unverified
5Lodge (DDIM)fid_k50Unverified
6Lodge (DDPM)fid_k45.56Unverified
7Lodge++fid_k40.77Unverified
8DanceMosaicfid_k19.36Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27Unverified
2TEMOSFID29.26Unverified
3MDMFID23.7Unverified
4T2MFID5.48Unverified
5InterGenFID5.21Unverified
6InterMaskFID0.4Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9Unverified
2TCDiffFID42.39Unverified
3GCDFID31.16Unverified
4Scalable Group ChoreographyFID31.01Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24Unverified
2TG-completeL2Q@50.17Unverified
3SSMCTL2Q@50.14Unverified
4-interpolatorL2Q@50.11Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8Unverified
2MLDFID3.41Unverified
3T2M-GPTFID1.37Unverified
4HumanTOMATOFID1.17Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59Unverified
2AIST++Frechet Inception Distance0.57Unverified
3Dance RevolutionFrechet Inception Distance0.52Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99Unverified
2MLDAccuracy0.96Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44Unverified