SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 101–150 of 270 papers

TitleStatusHype
Efficient Autoregressive Audio Modeling via Next-Scale PredictionCode2
Connective Viewpoints of Signal-to-Noise Diffusion Models—0
Nested Music Transformer: Sequentially Decoding Compound Tokens in Symbolic Music and Audio GenerationCode1
MMTrail: A Multimodal Trailer Video Dataset with Language and Music DescriptionsCode1
Braille-to-Speech Generator: Audio Generation Based on Joint Fine-Tuning of CLIP and Fastspeech2—0
Stable Audio OpenCode7
MEDIC: Zero-shot Music Editing with Disentangled Inversion Control—0
Modeling and Driving Human Body Soundfields through Acoustic Primitives—0
LiteFocus: Accelerated Diffusion Inference for Long Audio SynthesisCode1
Video-to-Audio Generation with Hidden Alignment—0
Read, Watch and Scream! Sound Generation from Text and VideoCode1
SOAF: Scene Occlusion-aware Neural Acoustic Field—0
FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized SoundsCode4
Taming Data and Transformers for Audio GenerationCode2
Provable Statistical Rates for Consistency Diffusion Models—0
Improving Text-To-Audio Models with Synthetic CaptionsCode5
Can Synthetic Audio From Generative Foundation Models Assist Audio Recognition and Speech Modeling?Code0
Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos—0
LAFMA: A Latent Flow Matching Model for Text-to-Audio GenerationCode1
Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio—0
AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation—0
Autoregressive Diffusion Transformer for Text-to-Speech Synthesis—0
SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial SoundCode2
Stochastic Diffusion: A Diffusion Probabilistic Model for Stochastic Time Series ForecastingCode0
Generative Pre-trained Speech Language Model with Efficient Hierarchical TransformerCode2
Creative Text-to-Audio Generation via Synthesizer Programming—0
AudioLCM: Text-to-Audio Generation with Latent Consistency ModelsCode5
Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow MatchingCode2
A Survey of Deep Learning Audio Generation Methods—0
SoundCTM: Unifying Score-based and Consistency Models for Full-band Text-to-Sound GenerationCode2
C3LLM: Conditional Multimodal Content Generation Using Large Language Models—0
The Rarity of Musical Audio Signals Within the Space of Possible Audio Generation—0
Visual Echoes: A Simple Unified Transformer for Audio-Visual Generation—0
Prompt-guided Precise Audio Editing with Diffusion Models—0
The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake AudioCode2
Leveraging AI to Generate Audio for User-generated Content in Video Games—0
Music Style Transfer With Diffusion Model—0
LVNS-RAVE: Diversified audio generation with RAVE and Latent Vector Novelty SearchCode0
LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights—0
Long-form music generation with latent diffusionCode7
Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference OptimizationCode5
Synthetic training set generation using text-to-audio models for environmental sound classification—0
Text-to-Audio Generation Synchronized with Videos—0
RFWave: Multi-band Rectified Flow for Audio Waveform ReconstructionCode2
(Un)paired signal-to-signal translation with 1D conditional GANs—0
Bespoke Non-Stationary Solvers for Fast Sampling of Diffusion and Flow Models—0
Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners—0
LLMBind: A Unified Modality-Task Integration FrameworkCode1
Language-Codec: Bridging Discrete Codec Representations and Speech Language ModelsCode3
Classification Diffusion Models: Revitalizing Density Ratio Estimation—0
Show:102550
← PrevPage 3 of 6Next →
All datasetsAudioCapsClassical music, 5 seconds at 12 kHzSymphony music

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53—Unverified
2AudioLDM2-largeFD_openl3158.04—Unverified
3Stable Audio 2.0FD_openl3110.62—Unverified
4Stable AudioFD_openl3103.66—Unverified
5ETTAFD_openl380.13—Unverified
6TangoFlux-baseFD_openl379.7—Unverified
7Stable Audio OpenFD_openl378.24—Unverified
8TangoFluxFD_openl375.1—Unverified
9ETTA-FT-AC-100kFD_openl361.79—Unverified
10DiffsoundFAD7.75—Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40—Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97—Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5—Unverified