SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 251–270 of 270 papers

TitleStatusHype
ReelWave: Multi-Agentic Movie Sound Generation through Multimodal LLM Conversation—0
Retrieval-Augmented Text-to-Audio Generation—0
Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners—0
SEFGAN: Harvesting the Power of Normalizing Flows and GANs for Efficient High-Quality Speech Enhancement—0
Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation—0
SingSong: Generating musical accompaniments from singing—0
Smooth-Foley: Creating Continuous Sound for Video-to-Audio Generation Under Semantic Guidance—0
SOAF: Scene Occlusion-aware Neural Acoustic Field—0
Soundify: Matching Sound Effects to Video—0
Sounding that Object: Interactive Object-Aware Image to Audio Generation—0
Speech Audio Generation from dynamic MRI via a Knowledge Enhanced Conditional Variational Autoencoder—0
FolAI: Synchronized Foley Sound Generation with Semantic and Temporal Alignment—0
Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance—0
Streamable Neural Audio Synthesis With Non-Causal Convolutions—0
SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning—0
Synchronized Video-to-Audio Generation via Mel Quantization-Continuum Decomposition—0
Synthetic training set generation using text-to-audio models for environmental sound classification—0
Audio Deepfake Attribution: An Initial Dataset and Investigation—0
TACOS: Temporally-aligned Audio CaptiOnS for Language-Audio Pretraining—0
TA-V2A: Textually Assisted Video-to-Audio Generation—0
Show:102550
← PrevPage 6 of 6Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified