SOTAVerified

Motion Synthesis

Creating a video where people in the images move (such as blinking or smiling) requires specialized AI technology like Deepfake or Motion Synthesis, which I cannot do directly here.

However, if you want a video made from the images you provided, I can create an animated slideshow with cute effects and royalty-free background music. Would you be interested in this?

Papers

Showing 251–282 of 282 papers

TitleStatusHype
Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Model—0
Diffusion Implicit Policy for Unpaired Scene-aware Motion Synthesis—0
Fatigue-PINN: Physics-Informed Fatigue-Driven Motion Modulation and Synthesis—0
Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Model—0
Fine-Grained Semantic Segmentation of Motion Capture Data using Dilated Temporal Fully-Convolutional Networks—0
XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration—0
A neural network based post-filter for speech-driven head motion synthesis—0
FlexMotion: Lightweight, Physics-Aware, and Controllable Human Motion Generation—0
FloVD: Optical Flow Meets Video Diffusion Model for Enhanced Camera-Controlled Video Synthesis—0
FlowMotion: Target-Predictive Conditional Flow Matching for Jitter-Reduced Text-Driven Human Motion Generation—0
FreeMotion: A Unified Framework for Number-free Text-to-Motion Synthesis—0
FreeMotion: MoCap-Free Human Motion Synthesis with Multimodal Large Language Models—0
Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation—0
GAN-based Reactive Motion Synthesis with Class-aware Discriminators for Human-human Interaction—0
Deterministic-to-Stochastic Diverse Latent Feature Mapping for Human Motion Synthesis—0
Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Rendering—0
Generating Continual Human Motion in Diverse 3D Scenes—0
Denoising Diffusion Probabilistic Models for Styled Walking Synthesis—0
Sketch2Anim: Towards Transferring Sketch Storyboards into 3D Animation—0
Stochastic Scene-Aware Motion Prediction—0
DEMOS: Dynamic Environment Motion Synthesis in 3D Scenes via Local Spherical-BEV Perception—0
Generative Motion Stylization of Cross-structure Characters within Canonical Motion Space—0
KETA: Kinematic-Phrases-Enhanced Text-to-Motion Generation via Fine-grained AlignmentCode0
Auto-Conditioned Recurrent Networks for Extended Complex Human Motion SynthesisCode0
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion SynthesisCode0
LawDNet: Enhanced Audio-Driven Lip Synthesis via Local Affine Warping DeformationCode0
KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance ArtCode0
On human motion prediction using recurrent neural networksCode0
DeepGesture: A conversational gesture synthesis system based on emotions and semanticsCode0
HP-GAN: Probabilistic 3D human motion prediction via GANCode0
A Neural Temporal Model for Human Motion PredictionCode0
Recurrent Transformer Variational Autoencoders for Multi-Action Motion SynthesisCode0
Show:102550
← PrevPage 6 of 6Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1Language2PoseFID11.02—Unverified
2Diffuion MotionFID10.21—Unverified
3Text2GestureFID5.01—Unverified
4TM2TFID1.5—Unverified
5T2MFID1.09—Unverified
6TM2D (t2m)FID1.02—Unverified
7MAAFID0.77—Unverified
8MotionDiffuseFID0.63—Unverified
9MDMFID0.54—Unverified
10MLDFID0.47—Unverified
#ModelMetricClaimedVerifiedStatus
1Text2GestureFID12.12—Unverified
2Language2PoseFID6.55—Unverified
3TEMOSFID3.72—Unverified
4TM2TFID3.6—Unverified
5T2MFID3.02—Unverified
6MotionDiffuseFID1.95—Unverified
7AttT2MFID0.87—Unverified
8T2M-GPT (τ = 0)FID0.74—Unverified
9T2M-GPT (τ = 0.5)FID0.72—Unverified
10Fg-T2MFID0.57—Unverified
#ModelMetricClaimedVerifiedStatus
1Dance RevolutionFID73.42—Unverified
2DanceNetFID69.13—Unverified
3MoFusionFID50.31—Unverified
4Lodge (DDPM)FID37.09—Unverified
5AI ChoreographerFID35.35—Unverified
6BailandoFID28.16—Unverified
7TM2D (only motion data)FID23.94—Unverified
8TM2DFID19.01—Unverified
9UDEFID17.25—Unverified
10Motion AnythingFID17.22—Unverified
#ModelMetricClaimedVerifiedStatus
1TEMOSFID17.38—Unverified
2T2MFID13.77—Unverified
3MDMFID9.17—Unverified
4ComMDMFID7.07—Unverified
5RIGFID6.78—Unverified
6FreeMotionFID6.74—Unverified
7InterGenFID5.92—Unverified
8MoMat-MoGenFID5.67—Unverified
9in2INFID5.18—Unverified
10InterMaskFID5.15—Unverified
#ModelMetricClaimedVerifiedStatus
1FACTfid_k113.38—Unverified
2MNETfid_k104.71—Unverified
3EDGEfid_k94.34—Unverified
4Bailandofid_k82.81—Unverified
5Lodge (DDIM)fid_k50—Unverified
6Lodge (DDPM)fid_k45.56—Unverified
7Lodge++fid_k40.77—Unverified
8DanceMosaicfid_k19.36—Unverified
#ModelMetricClaimedVerifiedStatus
1ComMDMFID29.27—Unverified
2TEMOSFID29.26—Unverified
3MDMFID23.7—Unverified
4T2MFID5.48—Unverified
5InterGenFID5.21—Unverified
6InterMaskFID0.4—Unverified
#ModelMetricClaimedVerifiedStatus
1GDANCERFID43.9—Unverified
2TCDiffFID42.39—Unverified
3GCDFID31.16—Unverified
4Scalable Group ChoreographyFID31.01—Unverified
#ModelMetricClaimedVerifiedStatus
1HM-VAEL2Q@50.24—Unverified
2TG-completeL2Q@50.17—Unverified
3SSMCTL2Q@50.14—Unverified
4-interpolatorL2Q@50.11—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMFID3.8—Unverified
2MLDFID3.41—Unverified
3T2M-GPTFID1.37—Unverified
4HumanTOMATOFID1.17—Unverified
#ModelMetricClaimedVerifiedStatus
1Dancing 2 MusicFrechet Inception Distance0.59—Unverified
2AIST++Frechet Inception Distance0.57—Unverified
3Dance RevolutionFrechet Inception Distance0.52—Unverified
#ModelMetricClaimedVerifiedStatus
1MDMAccuracy0.99—Unverified
2MLDAccuracy0.96—Unverified
#ModelMetricClaimedVerifiedStatus
1Motion AnythingFID21.46—Unverified
#ModelMetricClaimedVerifiedStatus
1Match-TTSGMean Opinion Score3.44—Unverified