SOTAVerified

Voice Cloning

Voice cloning is a highly desired feature for personalized speech interfaces. Neural voice cloning system learns to synthesize a person’s voice from only a few audio samples.

Papers

Recently AddedMost HypedMost ActiveNeeds VerificationMost Verified

Showing 1–50 of 112 papers

TitleStatusHype
Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech TokensCode11
IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech SystemCode11
CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic TokensCode11
FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMsCode11
Step-Audio: Unified Understanding and Generation in Intelligent Speech InteractionCode7
OpenVoice: Versatile Instant Voice CloningCode7
ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-SpeechCode6
Proactive Detection of Voice Cloning with Localized WatermarkingCode4
Enhancing Suno's Bark Text-to-Speech Model: Addressing Limitations Through Meta's Encodec and Pre-Trained HubertCode4
SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song GenerationCode3
Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice CloningCode3
Lina-Speech: Gated Linear Attention is a Fast and Parameter-Efficient Learner for text-to-speech synthesisCode2
EmoKnob: Enhance Voice Cloning with Fine-Grained Emotion ControlCode2
Small-E: Small Language Model with Linear Attention for Efficient Speech SynthesisCode2
StyleDubber: Towards Multi-Scale Style Learning for Movie DubbingCode2
LlamaPartialSpoof: An LLM-Driven Fake Speech Dataset Simulating Disinformation GenerationCode1
XTTS: a Massively Multilingual Zero-Shot Text-to-Speech ModelCode1
Anonymizing Speech: Evaluating and Designing Speaker Anonymization TechniquesCode1
Single and Multi-Speaker Cloned Voice Detection: From Perceptual to Learned FeaturesCode1
Txt2Vid: Ultra-Low Bitrate Compression of Talking-Head Videos via TextCode1
Building Bilingual and Code-Switched Voice Conversion with Limited Training Data Using Embedding Consistency LossCode1
One Model, Many Languages: Meta-learning for Multilingual Text-to-SpeechCode1
Pronunciation Deviation Analysis Through Voice Cloning and Acoustic Comparison—0
De-AntiFake: Rethinking the Protective Perturbations Against Voice Cloning Attacks—0
Few-Shot Speech Deepfake Detection Adaptation with Gaussian ProcessesCode0
Voice Adaptation for Swiss German—0
VoiceMark: Zero-Shot Voice Cloning-Resistant Watermarking Approach Leveraging Speaker-Specific Latents—0
Phir Hera Fairy: An English Fairytaler is a Strong Faker of Fluent Speech in Low-Resource Indian Languages—0
CloneShield: A Framework for Universal Perturbation Against Zero-Shot Voice Cloning—0
Beyond Face Swapping: A Diffusion-Based Digital Human Benchmark for Multimodal Deepfake Detection—0
MIKU-PAL: An Automated and Standardized Multi-Modal Method for Speech Paralinguistic and Affect Labeling—0
VoiceCloak: A Multi-Dimensional Defense Framework against Unauthorized Diffusion-based Voice Cloning—0
MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encoder—0
Voice Cloning: Comprehensive Survey—0
ClonEval: An Open Voice Cloning BenchmarkCode0
"It's not a representation of me": Examining Accent Bias and Digital Exclusion in Synthetic AI Voice Services—0
Empowering Global Voices: A Data-Efficient, Phoneme-Tone Adaptive Approach to High-Fidelity Speech Synthesis—0
SpeechDialogueFactory: Generating High-Quality Speech Dialogue Data to Accelerate Your Speech-LLM DevelopmentCode0
SoK: How Robust is Audio Watermarking in Generative AI models?—0
Voice Cloning for Dysarthric Speech Synthesis: Addressing Data Scarcity in Speech-Language Pathology—0
Steganography Beyond Space-Time with Chain of Multimodal AI—0
Deepfake Technology Unveiled: The Commoditization of AI and Its Impact on Digital Trust—0
Towards Lightweight and Stable Zero-shot TTS with Self-distilled Representation Disentanglement—0
MARS6: A Small and Robust Hierarchical-Codec Text-to-Speech Model—0
Advancing NAM-to-Speech Conversion with Novel Methods and the MultiNAM Dataset—0
Speech Watermarking with Discrete Intermediate Representations—0
Parallel Stacked Aggregated Network for Voice Authentication in IoT-Enabled Smart Devices—0
Hindi audio-video-Deepfake (HAV-DF): A Hindi language-based Audio-video Deepfake Dataset—0
The ISCSLP 2024 Conversational Voice Clone (CoVoC) Challenge: Tasks, Results and Findings—0
DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis—0
Show:102550
← PrevPage 1 of 3Next →

No leaderboard results yet.