SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 126–150 of 270 papers

TitleStatusHype
DiffGAP: A Lightweight Diffusion Module in Contrastive Space for Bridging Cross-Model Gap—0
AudioX: Diffusion Transformer for Anything-to-Audio Generation—0
TA-V2A: Textually Assisted Video-to-Audio Generation—0
Synchronized Video-to-Audio Generation via Mel Quantization-Continuum Decomposition—0
ReelWave: Multi-Agentic Movie Sound Generation through Multimodal LLM Conversation—0
Speech Audio Generation from dynamic MRI via a Knowledge Enhanced Conditional Variational Autoencoder—0
DualSpec: Text-to-spatial-audio Generation via Dual-Spectrogram Guided Diffusion Model—0
Towards efficient quantum algorithms for diffusion probability models—0
AudioSpa: Spatializing Sound Events with Text—0
UniForm: A Unified Multi-Task Diffusion Transformer for Audio-Video Generation—0
AudioGenX: Explainability on Text-to-Audio Generative ModelsCode0
CosyAudio: Improving Audio Generation with Confidence Scores and Synthetic Captions—0
Retrieval-Augmented Neural Field for HRTF Upsampling and PersonalizationCode0
CCStereo: Audio-Visual Contextual and Contrastive Learning for Binaural Audio Generation—0
Nonparametric estimation of a factorizable density using diffusion models—0
Foley-Flow: Coordinated Video-to-Audio Generation with Masked Audio-Visual Alignment and Dynamic Conditional Flows—0
Animate and Sound an Image—0
Tri-Ergon: Fine-grained Video-to-Audio Generation with Multi-modal Conditions and LUFS Control—0
VoiceDiT: Dual-Condition Diffusion Transformer for Environment-Aware Speech Synthesis—0
Smooth-Foley: Creating Continuous Sound for Video-to-Audio Generation Under Semantic Guidance—0
FolAI: Synchronized Foley Sound Generation with Semantic and Temporal Alignment—0
VinTAGe: Joint Video and Text Conditioning for Holistic Audio Generation—0
YingSound: Video-Guided Sound Effects Generation with Multi-modal Chain-of-Thought Controls—0
Comprehensive Audio Query Handling System with Integrated Expert Models and Contextual Understanding—0
Continuous Autoregressive Models with Noise Augmentation Avoid Error Accumulation—0
Show:102550
← PrevPage 6 of 11Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified