SOTAVerified

Audio Generation

Audio generation (synthesis) is the task of generating raw audio such as speech.

( Image credit: MelNet )

Papers

Showing 2130 of 270 papers

TitleStatusHype
Enhancing Suno's Bark Text-to-Speech Model: Addressing Limitations Through Meta's Encodec and Pre-Trained HubertCode4
Latent Swap Joint Diffusion for 2D Long-Form Latent GenerationCode4
High-Fidelity Audio Compression with Improved RVQGANCode3
OmniAudio: Generating Spatial Audio from 360-Degree VideoCode3
Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion ModelCode3
BigVGAN: A Universal Neural Vocoder with Large-Scale TrainingCode3
ESPnet-Codec: Comprehensive Training and Evaluation of Neural Codecs for Audio, Music, and SpeechCode3
Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language ModelCode3
Language-Codec: Bridging Discrete Codec Representations and Speech Language ModelsCode3
Movie Gen: A Cast of Media Foundation ModelsCode3
Show:102550
← PrevPage 3 of 27Next →

Benchmark Results

#ModelMetricClaimedVerifiedStatus
1AudioGenFD_openl3185.53Unverified
2AudioLDM2-largeFD_openl3158.04Unverified
3Stable Audio 2.0FD_openl3110.62Unverified
4Stable AudioFD_openl3103.66Unverified
5ETTAFD_openl380.13Unverified
6TangoFlux-baseFD_openl379.7Unverified
7Stable Audio OpenFD_openl378.24Unverified
8TangoFluxFD_openl375.1Unverified
9ETTA-FT-AC-100kFD_openl361.79Unverified
10DiffsoundFAD7.75Unverified
#ModelMetricClaimedVerifiedStatus
1VAB-Encodec (Ours)Bits per byte40Unverified
2Sparse Transformer 152M (strided)Bits per byte1.97Unverified
#ModelMetricClaimedVerifiedStatus
1SymphonyNet Human listening average results3.5Unverified