SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–125 of 270 papers

TitleStatusHype
A Survey of Deep Learning Audio Generation Methods—0
C3LLM: Conditional Multimodal Content Generation Using Large Language Models—0
A Survey of Automatic Evaluation Methods on Text, Visual and Speech Generations—0
Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation—0
A Demand-Driven Perspective on Generative Audio AI—0
Incremental Text to Speech for Neural Sequence-to-Sequence Models using Reinforcement Learning—0
FoleyGen: Visually-Guided Audio Generation—0
Foley-Flow: Coordinated Video-to-Audio Generation with Masked Audio-Visual Alignment and Dynamic Conditional Flows—0
Bespoke Non-Stationary Solvers for Fast Sampling of Diffusion and Flow Models—0
FlexLip: A Controllable Text-to-Lip System—0
FastWave: Accelerating Autoregressive Convolutional Neural Networks on FPGA—0
Bass Accompaniment Generation via Latent Diffusion—0
Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics—0
InfiniteAudio: Infinite-Length Audio Generation with Consistency—0
EzAudio: Enhancing Text-to-Audio Generation with Efficient Diffusion Transformer—0
Exploiting Audio-Visual Consistency with Partial Supervision for Spatial Audio Generation—0
EnvSDD: Benchmarking Environmental Sound Deepfake Detection—0
FreeAudio: Training-Free Timing Planning for Controllable Long-Form Text-to-Audio Generation—0
AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation—0
Autoregressive Diffusion Transformer for Text-to-Speech Synthesis—0
Enhance audio generation controllability through representation similarity regularization—0
Braille-to-Speech Generator: Audio Generation Based on Joint Fine-Tuning of CLIP and Fastspeech2—0
ELLA-V: Stable Neural Codec Language Modeling with Alignment-guided Sequence Reordering—0
Geometry-Aware Multi-Task Learning for Binaural Audio Generation from Video—0
Efficient Parallel Audio Generation using Group Masked Language Modeling—0
Show:102550
← PrevPage 5 of 11Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified