SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 201–250 of 270 papers

TitleStatusHype
Diffusion-EXR: Controllable Review Generation for Explainable Recommendation via Diffusion Models—0
Discrete Optimal Transport and Voice Conversion—0
DPN-GAN: Inducing Periodic Activations in Generative Adversarial Networks for High-Fidelity Audio Synthesis—0
DualSpec: Text-to-spatial-audio Generation via Dual-Spectrogram Guided Diffusion Model—0
Efficient Parallel Audio Generation using Group Masked Language Modeling—0
ELLA-V: Stable Neural Codec Language Modeling with Alignment-guided Sequence Reordering—0
Enhance audio generation controllability through representation similarity regularization—0
EnvSDD: Benchmarking Environmental Sound Deepfake Detection—0
Exploiting Audio-Visual Consistency with Partial Supervision for Spatial Audio Generation—0
EzAudio: Enhancing Text-to-Audio Generation with Efficient Diffusion Transformer—0
FastWave: Accelerating Autoregressive Convolutional Neural Networks on FPGA—0
FlexLip: A Controllable Text-to-Lip System—0
Foley-Flow: Coordinated Video-to-Audio Generation with Masked Audio-Visual Alignment and Dynamic Conditional Flows—0
FoleyGen: Visually-Guided Audio Generation—0
FreeAudio: Training-Free Timing Planning for Controllable Long-Form Text-to-Audio Generation—0
Geometry-Aware Multi-Task Learning for Binaural Audio Generation from Video—0
Guided Generative Adversarial Neural Network for Representation Learning and High Fidelity Audio Generation using Fewer Labelled Audio Data—0
High-Fidelity Audio Generation and Representation Learning with Guided Adversarial Autoencoder—0
IMPACT: Iterative Mask-based Parallel Decoding for Text-to-Audio Generation with Diffusion Modeling—0
In-Context Prompt Editing For Conditional Audio Generation—0
Incremental Text to Speech for Neural Sequence-to-Sequence Models using Reinforcement Learning—0
InfiniteAudio: Infinite-Length Audio Generation with Consistency—0
IteraTTA: An interface for exploring both text prompts and audio priors in generating music with text-to-audio models—0
Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation—0
LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights—0
Learning Source Disentanglement in Neural Audio Codec—0
Leveraging AI to Generate Audio for User-generated Content in Video Games—0
Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study—0
LiLAC: A Lightweight Latent ControlNet for Musical Audio Generation—0
LM-VC: Zero-shot Voice Conversion via Speech Generation based on Language Models—0
Make Some Noise: Towards LLM audio reasoning and generation using sound tokens—0
Masked Audio Generation using a Single Non-Autoregressive Transformer—0
MDSGen: Fast and Efficient Masked Diffusion Temporal-Aware Transformers for Open-Domain Sound Generation—0
MEDIC: Zero-shot Music Editing with Disentangled Inversion Control—0
MetaBGM: Dynamic Soundtrack Transformation For Continuous Multi-Scene Experiences With Ambient Awareness And Personalization—0
MMMG: a Comprehensive and Reliable Evaluation Suite for Multitask Multimodal Generation—0
Modeling and Driving Human Body Soundfields through Acoustic Primitives—0
Music Style Transfer With Diffusion Model—0
NDVQ: Robust Neural Audio Codec with Normal Distribution-Based Vector Quantization—0
Neural Granular Sound Synthesis—0
Nonparametric estimation of a factorizable density using diffusion models—0
NU-GAN: High resolution neural upsampling with GAN—0
On Target Representation in Continuous-output Neural Machine Translation—0
On the Design of Diffusion-based Neural Speech Codecs—0
On The Open Prompt Challenge In Conditional Audio Generation—0
PerceiverS: A Multi-Scale Perceiver with Effective Segmentation for Long-Term Expressive Symbolic Music Generation—0
Progressive Upsampling Audio Synthesis via Effective Adversarial Training—0
Prompt-guided Precise Audio Editing with Diffusion Models—0
Provable Statistical Rates for Consistency Diffusion Models—0
PTQ4ADM: Post-Training Quantization for Efficient Text Conditional Audio Diffusion Models—0
Show:102550
← PrevPage 5 of 6Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified