SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 51–75 of 270 papers

TitleStatusHype
SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound GenerationCode2
Diffsound: Discrete Diffusion Model for Text-to-sound GenerationCode2
SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial SoundCode2
Efficient Autoregressive Audio Modeling via Next-Scale PredictionCode2
TSELM: Target Speaker Extraction using Discrete Tokens and Language ModelsCode2
RefineGAN: Universally Generating Waveform Better than Ground Truth with Highly Accurate Pitch and Intensity ResponsesCode1
Adversarial Audio SynthesisCode1
Perceiving Music Quality with GANsCode1
ConsistencyTTA: Accelerating Diffusion-Based Text-to-Audio Generation with Consistency DistillationCode1
MusicLDM: Enhancing Novelty in Text-to-Music Generation Using Beat-Synchronous Mixup StrategiesCode1
Phonetic Posteriorgrams based Many-to-Many Singing Voice Conversion via Adversarial TrainingCode1
Read, Watch and Scream! Sound Generation from Text and VideoCode1
BemaGANv2: A Tutorial and Comparative Survey of GAN-based Vocoders for Long-Term Audio GenerationCode1
Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation and Editing via Content-based ControlsCode1
Neural Waveshaping SynthesisCode1
AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene SynthesisCode1
Blow: a single-scale hyperconditioned flow for non-parallel raw-audio voice conversionCode1
ADIFF: Explaining audio difference using natural languageCode1
MMTrail: A Multimodal Trailer Video Dataset with Language and Music DescriptionsCode1
Any-to-Any Generation via Composable DiffusionCode1
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio GenerationCode1
Nested Music Transformer: Sequentially Decoding Compound Tokens in Symbolic Music and Audio GenerationCode1
Anytime Sampling for Autoregressive Models via Ordered AutoencodingCode1
LooPy: A Research-Friendly Mix Framework for Music Information Retrieval on Electronic Dance MusicCode1
Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale CorpusCode1
Show:102550
← PrevPage 3 of 11Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified