SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 282 papers

TitleStatusHype
One Policy but Many Worlds: A Scalable Unified Policy for Versatile Humanoid Locomotion—0
On the Benefit of Generative Foundation Models for Human Activity Recognition—0
Open-World Pose Transfer via Sequential Test-Time Adaption—0
PACE: Data-Driven Virtual Agent Interaction in Dense and Cluttered Environments—0
A Unified Masked Autoencoder with Patchified Skeletons for Motion Synthesis—0
PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics—0
Physics-based Human Motion Estimation and Synthesis from Videos—0
Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes—0
PlanMoGPT: Flow-Enhanced Progressive Planning for Text to Motion Synthesis—0
Towards a GENEA Leaderboard -- an Extended, Living Benchmark for Evaluating and Advancing Conversational Motion Synthesis—0
Ponymation: Learning 3D Animal Motions from Unlabeled Online Videos—0
PoseSyn: Synthesizing Diverse 3D Pose Data from In-the-Wild 2D Data—0
Pose-to-Motion: Cross-Domain Motion Retargeting with Pose Prior—0
Pretrained Diffusion Models for Unified Human Motion Synthesis—0
Probabilistic Speech-Driven 3D Facial Motion Synthesis: New Benchmarks, Methods, and Applications—0
Probabilistic Speech-Driven 3D Facial Motion Synthesis: New Benchmarks Methods and Applications—0
Towards Detailed Text-to-Motion Synthesis via Basic-to-Advanced Hierarchical Diffusion Model—0
PT-MMD: A Novel Statistical Framework for the Evaluation of Generative Systems—0
Recognition and Synthesis of Object Transport Motion—0
ReCoM: Realistic Co-Speech Motion Generation with Recurrent Embedded Transformer—0
A Unified Framework for Multimodal, Multi-Part Human Motion Synthesis—0
A Unified 3D Human Motion Synthesis Model via Conditional Variational Auto-Encoder—0
Towards Diverse and Natural Scene-aware 3D Human Motion Synthesis—0
Towards Practical Single-shot Motion Synthesis—0
Rhythm is a Dancer: Music-Driven Motion Synthesis with Global Structure—0
Riemann^2: Learning Riemannian Submanifolds from Riemannian Data—0
ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors—0
Articulated Kinematics Distillation from Video Diffusion Models—0
TextIM: Part-aware Interactive Motion Synthesis from Text—0
SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusion—0
Scalable Group Choreography via Variational Phase Manifold Learning—0
Scaling Up Dynamic Human-Scene Interaction Modeling—0
Scene-aware Generative Network for Human Motion Synthesis—0
SCENIC: Scene-aware Semantic Navigation with Instruction-guided Control—0
A Nonparametric Framework for Quantifying Generative Inference on Neuromorphic Systems—0
Enhanced Fine-grained Motion Diffusion for Text-driven Human Motion Synthesis—0
DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding—0
Separate to Collaborate: Dual-Stream Diffusion Model for Coordinated Piano Hand Motion Synthesis—0
DiverseMotion: Towards Diverse Human Motion Generation via Discrete Diffusion—0
DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidance—0
Shape Conditioned Human Motion Generation with Diffusion Model—0
DROP: Dynamics Responses from Human Motion Prior and Projective Dynamics—0
Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motions—0
Dyadic Mamba: Long-term Dyadic Human Motion Synthesis—0
Dynamic Motion Synthesis: Masked Audio-Text Conditioned Spatio-Temporal Transformers—0
Dilated Temporal Fully-Convolutional Network for Semantic Segmentation of Motion Capture Data—0
Efficient Listener: Dyadic Facial Motion Synthesis via Action Diffusion—0
EgoGen: An Egocentric Synthetic Data Generator—0
Unified speech and gesture synthesis using flow matching—0
Digital Life Project: Autonomous 3D Characters with Social Intelligence—0
Show:102550
← PrevPage 5 of 6Next →
All datasetsHumanML3DKIT Motion-LanguageAIST++InterHumanFineDanceInter-XAIOZ-GDANCELaFAN1Motion-XBRACEHumanAct12TMD

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02—Unverified
2Diffuion MotionFID10.21—Unverified
3Text2GestureFID5.01—Unverified
4TM2TFID1.5—Unverified
5T2MFID1.09—Unverified
6TM2D (t2m)FID1.02—Unverified
7MAAFID0.77—Unverified
8MotionDiffuseFID0.63—Unverified
9MDMFID0.54—Unverified
10MLDFID0.47—Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12—Unverified
2Language2PoseFID6.55—Unverified
3TEMOSFID3.72—Unverified
4TM2TFID3.6—Unverified
5T2MFID3.02—Unverified
6MotionDiffuseFID1.95—Unverified
7AttT2MFID0.87—Unverified
8T2M-GPT (τ = 0)FID0.74—Unverified
9T2M-GPT (τ = 0.5)FID0.72—Unverified
10Fg-T2MFID0.57—Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42—Unverified
2DanceNetFID69.13—Unverified
3MoFusionFID50.31—Unverified
4Lodge (DDPM)FID37.09—Unverified
5AI ChoreographerFID35.35—Unverified
6BailandoFID28.16—Unverified
7TM2D (only motion data)FID23.94—Unverified
8TM2DFID19.01—Unverified
9UDEFID17.25—Unverified
10Motion AnythingFID17.22—Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38—Unverified
2T2MFID13.77—Unverified
3MDMFID9.17—Unverified
4ComMDMFID7.07—Unverified
5RIGFID6.78—Unverified
6FreeMotionFID6.74—Unverified
7InterGenFID5.92—Unverified
8MoMat-MoGenFID5.67—Unverified
9in2INFID5.18—Unverified
10InterMaskFID5.15—Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38—Unverified
2MNETfid_k104.71—Unverified
3EDGEfid_k94.34—Unverified
4Bailandofid_k82.81—Unverified
5Lodge (DDIM)fid_k50—Unverified
6Lodge (DDPM)fid_k45.56—Unverified
7Lodge++fid_k40.77—Unverified
8DanceMosaicfid_k19.36—Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27—Unverified
2TEMOSFID29.26—Unverified
3MDMFID23.7—Unverified
4T2MFID5.48—Unverified
5InterGenFID5.21—Unverified
6InterMaskFID0.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9—Unverified
2TCDiffFID42.39—Unverified
3GCDFID31.16—Unverified
4Scalable Group ChoreographyFID31.01—Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24—Unverified
2TG-completeL2Q@50.17—Unverified
3SSMCTL2Q@50.14—Unverified
4-interpolatorL2Q@50.11—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8—Unverified
2MLDFID3.41—Unverified
3T2M-GPTFID1.37—Unverified
4HumanTOMATOFID1.17—Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59—Unverified
2AIST++Frechet Inception Distance0.57—Unverified
3Dance RevolutionFrechet Inception Distance0.52—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99—Unverified
2MLDAccuracy0.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44—Unverified