SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 226–250 of 270 papers

TitleStatusHype
Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation—0
LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights—0
Learning Source Disentanglement in Neural Audio Codec—0
Leveraging AI to Generate Audio for User-generated Content in Video Games—0
Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study—0
LiLAC: A Lightweight Latent ControlNet for Musical Audio Generation—0
LM-VC: Zero-shot Voice Conversion via Speech Generation based on Language Models—0
Make Some Noise: Towards LLM audio reasoning and generation using sound tokens—0
Masked Audio Generation using a Single Non-Autoregressive Transformer—0
MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation—0
MEDIC: Zero-shot Music Editing with Disentangled Inversion Control—0
MetaBGM: Dynamic Soundtrack Transformation For Continuous Multi-Scene Experiences With Ambient Awareness And Personalization—0
MMMG: a Comprehensive and Reliable Evaluation Suite for Multitask Multimodal Generation—0
Modeling and Driving Human Body Soundfields through Acoustic Primitives—0
Music Source Separation in the Waveform Domain—0
Music Style Transfer With Diffusion Model—0
NDVQ: Robust Neural Audio Codec with Normal Distribution-Based Vector Quantization—0
Neural Granular Sound Synthesis—0
Nonparametric estimation of a factorizable density using diffusion models—0
NU-GAN: High resolution neural upsampling with GAN—0
On Target Representation in Continuous-output Neural Machine Translation—0
On the Design of Diffusion-based Neural Speech Codecs—0
On The Open Prompt Challenge In Conditional Audio Generation—0
PerceiverS: A Multi-Scale Perceiver with Effective Segmentation for Long-Term Expressive Symbolic Music Generation—0
PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior—0
Show:102550
← PrevPage 10 of 11Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified