SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 270 papers

TitleStatusHype
PerceiverS: A Multi-Scale Perceiver with Effective Segmentation for Long-Term Expressive Symbolic Music Generation—0
PriorGrad: Improving Conditional Denoising Diffusion Models with Data-Dependent Adaptive Prior—0
Progressive Upsampling Audio Synthesis via Effective Adversarial Training—0
Prompt-guided Precise Audio Editing with Diffusion Models—0
Provable Statistical Rates for Consistency Diffusion Models—0
PTQ4ADM: Post-Training Quantization for Efficient Text Conditional Audio Diffusion Models—0
ReelWave: Multi-Agentic Movie Sound Generation through Multimodal LLM Conversation—0
Retrieval-Augmented Text-to-Audio Generation—0
Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners—0
SEFGAN: Harvesting the Power of Normalizing Flows and GANs for Efficient High-Quality Speech Enhancement—0
Sep-Stereo: Visually Guided Stereophonic Audio Generation by Associating Source Separation—0
SingSong: Generating musical accompaniments from singing—0
Smooth-Foley: Creating Continuous Sound for Video-to-Audio Generation Under Semantic Guidance—0
SOAF: Scene Occlusion-aware Neural Acoustic Field—0
Soundify: Matching Sound Effects to Video—0
Sounding that Object: Interactive Object-Aware Image to Audio Generation—0
Speech Audio Generation from dynamic MRI via a Knowledge Enhanced Conditional Variational Autoencoder—0
FolAI: Synchronized Foley Sound Generation with Semantic and Temporal Alignment—0
Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance—0
Streamable Neural Audio Synthesis With Non-Causal Convolutions—0
SUPERB @ SLT 2022: Challenge on Generalization and Efficiency of Self-Supervised Speech Representation Learning—0
YingSound: Video-Guided Sound Effects Generation with Multi-modal Chain-of-Thought Controls—0
Multimodal Cinematic Video Synthesis Using Text-to-Image and Audio Generation Models—0
A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directions—0
Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos—0
ADD 2022: the First Audio Deep Synthesis Detection Challenge—0
A Demand-Driven Perspective on Generative Audio AI—0
Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics—0
Adversarial Audio Synthesis with Complex-valued Polynomial Networks—0
Analyzing and Mitigating Inconsistency in Discrete Audio Tokens for Neural Codec Language Models—0
Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization—0
Animate and Sound an Image—0
An investigation of pre-upsampling generative modelling and Generative Adversarial Networks in audio super resolution—0
Applications and Advances of Artificial Intelligence in Music Generation:A Review—0
A Survey of Automatic Evaluation Methods on Text, Visual and Speech Generations—0
A Survey of Deep Learning Audio Generation Methods—0
Audio-Agent: Leveraging LLMs For Audio Generation, Editing and Composition—0
Audiobox TTA-RAG: Improving Zero-Shot and Few-Shot Text-To-Audio with Retrieval-Augmented Generation—0
Audiobox: Unified Audio Generation with Natural Language Prompts—0
AudioComposer: Towards Fine-grained Audio Generation with Natural Language Descriptions—0
Audio Dequantization for High Fidelity Audio Generation in Flow-based Neural Vocoder—0
Audio Editing with Non-Rigid Text Prompts—0
Audio Generation with Multiple Conditional Diffusion Model—0
AudioSpa: Spatializing Sound Events with Text—0
AudioTurbo: Fast Text-to-Audio Generation with Rectified Diffusion—0
AudioX: Diffusion Transformer for Anything-to-Audio Generation—0
Autoregressive Diffusion Transformer for Text-to-Speech Synthesis—0
AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation—0
Bass Accompaniment Generation via Latent Diffusion—0
Bespoke Non-Stationary Solvers for Fast Sampling of Diffusion and Flow Models—0
Show:102550
← PrevPage 3 of 6Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified