SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 151–200 of 270 papers

TitleStatusHype
Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation and Editing via Content-based ControlsCode1
Fast Timing-Conditioned Latent Audio DiffusionCode7
Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization—0
Bass Accompaniment Generation via Latent Diffusion—0
EVA-GAN: Enhanced Various Audio Generation via Scalable Generative Adversarial NetworksCode2
T-FOLEY: A Controllable Waveform-Domain Diffusion Model for Temporal-Event-Guided Foley Sound SynthesisCode1
ELLA-V: Stable Neural Codec Language Modeling with Alignment-guided Sequence Reordering—0
Masked Audio Generation using a Single Non-Autoregressive Transformer—0
Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio GenerationCode2
Efficient Parallel Audio Generation using Group Masked Language Modeling—0
Cyclic Learning for Binaural Audio Generation and Localization—0
Audiobox: Unified Audio Generation with Natural Language Prompts—0
Diffusion-EXR: Controllable Review Generation for Explainable Recommendation via Diffusion Models—0
CMMD: Contrastive Multi-Modal Diffusion for Video-Audio Conditional Modeling—0
SEFGAN: Harvesting the Power of Normalizing Flows and GANs for Efficient High-Quality Speech Enhancement—0
tinyCLAP: Distilling Constrastive Language-Audio Pretrained Models—0
Cross-modal Generative Model for Visual-Guided Binaural Stereo Generation—0
On The Open Prompt Challenge In Conditional Audio Generation—0
In-Context Prompt Editing For Conditional Audio Generation—0
Audio Editing with Non-Rigid Text Prompts—0
Speech collage: code-switched audio generation by collaging monolingual corporaCode1
Invisible Watermarking for Audio Generation Diffusion ModelsCode1
FoleyGen: Visually-Guided Audio Generation—0
ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency DistillationCode1
Enhance audio generation controllability through representation similarity regularization—0
Retrieval-Augmented Text-to-Audio Generation—0
Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics—0
WavMark: Watermarking for Audio GenerationCode2
Audio Generation with Multiple Conditional Diffusion Model—0
An Initial Exploration: Learning to Generate Realistic Audio for Silent VideoCode0
V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation ModelsCode1
AudioLDM 2: Learning Holistic Audio Generation with Self-supervised PretrainingCode4
MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup StrategiesCode1
WavJourney: Compositional Audio Creation with Large Language ModelsCode2
IteraTTA: An interface for exploring both text prompts and audio priors in generating music with text-to-audio models—0
A Demand-Driven Perspective on Generative Audio AI—0
LM-VC: Zero-shot Voice Conversion via Speech Generation based on Language Models—0
High-Fidelity Audio Compression with Improved RVQGANCode3
MuseCoco: Generating Symbolic Music from TextCode0
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio GenerationCode1
An Efficient Membership Inference Attack for the Diffusion Model by Proximal InitializationCode1
DiffAVA: Personalized Text-to-Audio Generation with Visual Alignment—0
Any-to-Any Generation via Composable DiffusionCode1
SoundStorm: Efficient Parallel Audio GenerationCode6
LooPy: A Research-Friendly Mix Framework for Music Information Retrieval on Electronic Dance MusicCode1
Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion ModelCode3
Enhancing Suno's Bark Text-to-Speech Model: Addressing Limitations Through Meta's Encodec and Pre-Trained HubertCode4
Sounding Video Generator: A Unified Framework for Text-guided Sounding Video GenerationCode0
Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study—0
AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene SynthesisCode1
Show:102550
← PrevPage 4 of 6Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified