SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–100 of 282 papers

TitleStatusHype
Broadband Ground Motion Synthesis by Diffusion Model with Minimal Condition—0
SCENIC: Scene-aware Semantic Navigation with Instruction-guided Control—0
Motion-2-to-3: Leveraging 2D Motion Data to Boost 3D Motion Generation—0
Text-to-3D Gaussian Splatting with Physics-Grounded Motion Generation—0
It Takes Two: Real-time Co-Speech Two-person's Interaction Generation via Reactive Auto-regressive Diffusion Model—0
Diffusion Implicit Policy for Unpaired Scene-aware Motion Synthesis—0
DisCoRD: Discrete Tokens to Continuous Motion via Rectified Flow Decoding—0
BiPO: Bidirectional Partial Occlusion Network for Text-to-Motion Synthesis—0
XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration—0
I2VControl: Disentangled and Unified Video Motion Synthesis Control—0
MotionLLaMA: A Unified Framework for Motion Synthesis and ComprehensionCode2
KinMo: Kinematic-aware Human Motion Understanding and Generation—0
Decoupling Training-Free Guided Diffusion by ADMM—0
Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and ConditioningCode1
Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patterns—0
LEAD: Latent Realignment for Human Motion Diffusion—0
Sitcom-Crafter: A Plot-Driven Human Motion Generation System in 3D ScenesCode2
InterMask: 3D Human Interaction Generation via Collaborative Masked ModellingCode1
Versatile Motion Language Models for Multi-Turn Interactive Agents—0
Towards a GENEA Leaderboard -- an Extended, Living Benchmark for Evaluating and Advancing Conversational Motion Synthesis—0
DartControl: A Diffusion-Based Autoregressive Motion Model for Real-Time Text-Driven Motion Control—0
Unimotion: Unifying 3D Human Motion Synthesis and Understanding—0
BAD: Bidirectional Auto-regressive Diffusion for Text-to-Motion GenerationCode2
LawDNet: Enhanced Audio-Driven Lip Synthesis via Local Affine Warping DeformationCode0
Dynamic Motion Synthesis: Masked Audio-Text Conditioned Spatio-Temporal Transformers—0
T3M: Text Guided 3D Human Motion Synthesis from SpeechCode1
Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Models—0
TextIM: Part-aware Interactive Motion Synthesis from Text—0
MotionCraft: Crafting Whole-Body Motion with Plug-and-Play Multimodal ControlsCode2
Scalable Group Choreography via Variational Phase Manifold Learning—0
Length-Aware Motion Synthesis via Latent DiffusionCode1
Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation—0
Infinite Motion: Extended Motion Generation via Long Text Instructions—0
FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models—0
Nymeria: A Massive Collection of Multimodal Egocentric Daily Motion in the Wild—0
Monkey See, Monkey Do: Harnessing Self-attention in Motion Diffusion for Zero-shot Motion TransferCode1
MotionClone: Training-Free Motion Cloning for Controllable Video GenerationCode4
MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Training—0
Towards Practical Single-shot Motion Synthesis—0
FreeMotion: A Unified Framework for Number-free Text-to-Motion Synthesis—0
Shape Conditioned Human Motion Generation with Diffusion Model—0
MotionLCM: Real-time Controllable Motion Generation via Latent Consistency ModelCode3
MCM: Multi-condition Motion Synthesis FrameworkCode1
in2IN: Leveraging individual Information to Generate Human INteractionsCode2
BAMM: Bidirectional Autoregressive Motion ModelCode2
OAKINK2: A Dataset of Bimanual Hands-Object Manipulation in Complex Task Completion—0
ParCo: Part-Coordinating Text-to-Motion SynthesisCode2
Move as You Say, Interact as You Can: Language-guided Human Motion Generation with Scene AffordanceCode2
Contact-aware Human Motion Generation from Textual Descriptions—0
Driving Animatronic Robot Facial Expression From SpeechCode1
Show:102550
← PrevPage 2 of 6Next →
All datasetsHumanML3DKIT Motion-LanguageAIST++InterHumanFineDanceInter-XAIOZ-GDANCELaFAN1Motion-XBRACEHumanAct12TMD

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02—Unverified
2Diffuion MotionFID10.21—Unverified
3Text2GestureFID5.01—Unverified
4TM2TFID1.5—Unverified
5T2MFID1.09—Unverified
6TM2D (t2m)FID1.02—Unverified
7MAAFID0.77—Unverified
8MotionDiffuseFID0.63—Unverified
9MDMFID0.54—Unverified
10MLDFID0.47—Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12—Unverified
2Language2PoseFID6.55—Unverified
3TEMOSFID3.72—Unverified
4TM2TFID3.6—Unverified
5T2MFID3.02—Unverified
6MotionDiffuseFID1.95—Unverified
7AttT2MFID0.87—Unverified
8T2M-GPT (τ = 0)FID0.74—Unverified
9T2M-GPT (τ = 0.5)FID0.72—Unverified
10Fg-T2MFID0.57—Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42—Unverified
2DanceNetFID69.13—Unverified
3MoFusionFID50.31—Unverified
4Lodge (DDPM)FID37.09—Unverified
5AI ChoreographerFID35.35—Unverified
6BailandoFID28.16—Unverified
7TM2D (only motion data)FID23.94—Unverified
8TM2DFID19.01—Unverified
9UDEFID17.25—Unverified
10Motion AnythingFID17.22—Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38—Unverified
2T2MFID13.77—Unverified
3MDMFID9.17—Unverified
4ComMDMFID7.07—Unverified
5RIGFID6.78—Unverified
6FreeMotionFID6.74—Unverified
7InterGenFID5.92—Unverified
8MoMat-MoGenFID5.67—Unverified
9in2INFID5.18—Unverified
10InterMaskFID5.15—Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38—Unverified
2MNETfid_k104.71—Unverified
3EDGEfid_k94.34—Unverified
4Bailandofid_k82.81—Unverified
5Lodge (DDIM)fid_k50—Unverified
6Lodge (DDPM)fid_k45.56—Unverified
7Lodge++fid_k40.77—Unverified
8DanceMosaicfid_k19.36—Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27—Unverified
2TEMOSFID29.26—Unverified
3MDMFID23.7—Unverified
4T2MFID5.48—Unverified
5InterGenFID5.21—Unverified
6InterMaskFID0.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9—Unverified
2TCDiffFID42.39—Unverified
3GCDFID31.16—Unverified
4Scalable Group ChoreographyFID31.01—Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24—Unverified
2TG-completeL2Q@50.17—Unverified
3SSMCTL2Q@50.14—Unverified
4-interpolatorL2Q@50.11—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8—Unverified
2MLDFID3.41—Unverified
3T2M-GPTFID1.37—Unverified
4HumanTOMATOFID1.17—Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59—Unverified
2AIST++Frechet Inception Distance0.57—Unverified
3Dance RevolutionFrechet Inception Distance0.52—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99—Unverified
2MLDAccuracy0.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44—Unverified