SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–10 of 270 papers

TitleStatusHype
FreeAudio: Training-Free Timing Planning for Controllable Long-Form Text-to-Audio Generation—0
Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance—0
ThinkSound: Chain-of-Thought Reasoning in Multimodal Large Language Models for Audio Generation and EditingCode5
Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation—0
LiLAC: A Lightweight Latent ControlNet for Musical Audio Generation—0
ViSAGe: Video-to-Spatial Audio Generation—0
BemaGANv2: A Tutorial and Comparative Survey of GAN-based Vocoders for Long-Term Audio GenerationCode1
A Survey of Automatic Evaluation Methods on Text, Visual and Speech Generations—0
Sounding that Object: Interactive Object-Aware Image to Audio Generation—0
InfiniteAudio: Infinite-Length Audio Generation with Consistency—0
Show:102550
← PrevPage 1 of 27Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified