SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Showing 101150 of 282 papers

TitleStatusHype
Point-Based Radiance Fields for Controllable Human Motion SynthesisCode1
Constrained Synthesis with Projected Diffusion ModelsCode1
ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person InteractionsCode1
Residual Force Control for Agile Human Behavior Imitation and Extended Motion SynthesisCode1
Role-Aware Interaction Generation from Textual DescriptionCode1
Self-Correcting Self-Consuming Loops for Generative Model TrainingCode1
Single-Shot Motion Completion with TransformerCode1
Skeleton2Humanoid: Animating Simulated Characters for Physically-plausible Motion In-betweeningCode1
Style-Controllable Speech-Driven Gesture Synthesis Using Normalising FlowsCode1
Synthesis of Compositional Animations from Textual DescriptionsCode1
Synthesizing Long-Term 3D Human Motion and Interaction in 3D ScenesCode1
T3M: Text Guided 3D Human Motion Synthesis from SpeechCode1
TM2D: Bimodality Driven 3D Dance Generation via Music-Text IntegrationCode1
TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and TextsCode1
UDE: A Unified Driving Engine for Human Motion GenerationCode1
Unifying Human Motion Synthesis and Style Transfer with Denoising Diffusion Probabilistic ModelsCode1
KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance ArtCode0
Auto-Conditioned Recurrent Networks for Extended Complex Human Motion SynthesisCode0
On human motion prediction using recurrent neural networksCode0
KETA: Kinematic-Phrases-Enhanced Text-to-Motion Generation via Fine-grained AlignmentCode0
HP-GAN: Probabilistic 3D human motion prediction via GANCode0
DeepGesture: A conversational gesture synthesis system based on emotions and semanticsCode0
Recurrent Transformer Variational Autoencoders for Multi-Action Motion SynthesisCode0
LawDNet: Enhanced Audio-Driven Lip Synthesis via Local Affine Warping DeformationCode0
A Neural Temporal Model for Human Motion PredictionCode0
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion SynthesisCode0
Contact-aware Human Motion Generation from Textual Descriptions0
It Takes Two: Real-time Co-Speech Two-person's Interaction Generation via Reactive Auto-regressive Diffusion Model0
Jointly Understand Your Command and Intention:Reciprocal Co-Evolution between Scene-Aware 3D Human Motion Synthesis and Analysis0
KinMo: Kinematic-aware Human Motion Understanding and Generation0
Synthesising 3D Facial Motion from "In-the-Wild" Speech0
LEAD: Latent Realignment for Human Motion Diffusion0
Unimotion: Unifying 3D Human Motion Synthesis and Understanding0
Learning to Generate Diverse Dance Motions with Transformer0
Learning to Sit: Synthesizing Human-Chair Interactions via Hierarchical Control0
Unlocking Pretrained LLMs for Motion-Related Multimodal Generation: A Fine-Tuning Approach to Unify Diffusion and Next-Token Prediction0
Analysis of Co-Laughter Gesture Relationship on RGB Videos in Dyadic Conversation Context0
Less is More: Improving Motion Diffusion Models with Sparse Keyframes0
UNOC: Understanding Occlusion for Embodied Presence in Virtual Reality0
Local Action-Guided Motion Diffusion Model for Text-to-Motion Generation0
Broadband Ground Motion Synthesis by Diffusion Model with Minimal Condition0
Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patterns0
LS-GAN: Human Motion Synthesis with Latent-space GANs0
M3G: Multi-Granular Gesture Generator for Audio-Driven Full-Body Human Motion Synthesis0
MACS: Mass Conditioned 3D Hand and Object Motion Synthesis0
Talking With Hands 16.2M: A Large-Scale Dataset of Synchronized Body-Finger Motion and Audio for Conversational Motion Analysis and Synthesis0
Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation0
Target-Aware Video Diffusion Models0
Task-Generic Hierarchical Human Motion Prior using VAEs0
Task-Oriented Human-Object Interactions Generation with Implicit Neural Representations0
Show:102550
← PrevPage 3 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02Unverified
2Diffuion MotionFID10.21Unverified
3Text2GestureFID5.01Unverified
4TM2TFID1.5Unverified
5T2MFID1.09Unverified
6TM2D (t2m)FID1.02Unverified
7MAAFID0.77Unverified
8MotionDiffuseFID0.63Unverified
9MDMFID0.54Unverified
10MLDFID0.47Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12Unverified
2Language2PoseFID6.55Unverified
3TEMOSFID3.72Unverified
4TM2TFID3.6Unverified
5T2MFID3.02Unverified
6MotionDiffuseFID1.95Unverified
7AttT2MFID0.87Unverified
8T2M-GPT (τ = 0)FID0.74Unverified
9T2M-GPT (τ = 0.5)FID0.72Unverified
10Fg-T2MFID0.57Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42Unverified
2DanceNetFID69.13Unverified
3MoFusionFID50.31Unverified
4Lodge (DDPM)FID37.09Unverified
5AI ChoreographerFID35.35Unverified
6BailandoFID28.16Unverified
7TM2D (only motion data)FID23.94Unverified
8TM2DFID19.01Unverified
9UDEFID17.25Unverified
10Motion AnythingFID17.22Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38Unverified
2T2MFID13.77Unverified
3MDMFID9.17Unverified
4ComMDMFID7.07Unverified
5RIGFID6.78Unverified
6FreeMotionFID6.74Unverified
7InterGenFID5.92Unverified
8MoMat-MoGenFID5.67Unverified
9in2INFID5.18Unverified
10InterMaskFID5.15Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38Unverified
2MNETfid_k104.71Unverified
3EDGEfid_k94.34Unverified
4Bailandofid_k82.81Unverified
5Lodge (DDIM)fid_k50Unverified
6Lodge (DDPM)fid_k45.56Unverified
7Lodge++fid_k40.77Unverified
8DanceMosaicfid_k19.36Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27Unverified
2TEMOSFID29.26Unverified
3MDMFID23.7Unverified
4T2MFID5.48Unverified
5InterGenFID5.21Unverified
6InterMaskFID0.4Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9Unverified
2TCDiffFID42.39Unverified
3GCDFID31.16Unverified
4Scalable Group ChoreographyFID31.01Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24Unverified
2TG-completeL2Q@50.17Unverified
3SSMCTL2Q@50.14Unverified
4-interpolatorL2Q@50.11Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8Unverified
2MLDFID3.41Unverified
3T2M-GPTFID1.37Unverified
4HumanTOMATOFID1.17Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59Unverified
2AIST++Frechet Inception Distance0.57Unverified
3Dance RevolutionFrechet Inception Distance0.52Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99Unverified
2MLDAccuracy0.96Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44Unverified