CosyVoice3 Evaluation Results
December 26, 2025 · View on GitHub
Model: cosyvoice3-latest (config)
Evaluation Date: 2025/12/17
Paper/Repo: FunAudioLLM/Fun-CosyVoice3-0.5B-2512
Metrics Legend:
- WER⬇️: Word Error Rate (lower is better)
- CER⬇️: Character Error Rate (lower is better)
- SIM⬆️: Speaker Similarity (higher is better)
- P808_MOS⬆️: DNSMOS P.808 Mean Opinion Score (higher is better)
Note: Update (2025/12/17): results may change as FunAudioLLM/CosyVoice is updated.
Seed-TTS-Eval Benchmark
| task | dataset | WER/CER⬇️ | SIM⬆️ | eval_cli | note |
|---|---|---|---|---|---|
| tts | seed_tts_eval_en | 2.14(2.24) | 69.45(71.8) | [1] | |
| tts | seed_tts_eval_zh | 1.14(1.21) | 77.55(78.0) | [2] |
CV3 Benchmark (Zero-Shot)
| task | dataset | WER/CER⬇️ | SIM⬆️ | P808_MOS⬆️ | eval_cli | note |
|---|---|---|---|---|---|---|
| tts | cv3_zero_shot_en | 5.01 | 74.44 | 3.84 | [3] | |
| tts | cv3_zero_shot_zh | 4.06 | 79.99 | 3.88 | [4] | |
| tts | cv3_zero_shot_hard_en | 11.05 | 74.33 | 3.99 | [5] | |
| tts | cv3_zero_shot_hard_zh | 7.43 | 78.63 | 3.84 | [6] |
Long-TTS-Eval Benchmark
| task | dataset | WER(%)⬇️ | eval_cli | note |
|---|---|---|---|---|
| tts | long_tts_eval_en | 92.63 | [7] | |
| tts | long_tts_eval_zh | 87.17 | [8] | |
| tts | long_tts_eval_hard_en | 78.20 | [9] | |
| tts | long_tts_eval_hard_zh | 69.59 | [10] |
Long-TTS-Eval Benchmark (zero_shot-overall.json)
| task | dataset | WER(%)⬇️ | note |
|---|---|---|---|
| tts | long_tts_eval_en | - | error: list index out of range (see res/cosyvoice3-latest/long_tts_eval_en/zero_shot-log.txt) |
| tts | long_tts_eval_zh | - | error: list index out of range (see res/cosyvoice3-latest/long_tts_eval_zh/zero_shot-log.txt) |
| tts | long_tts_eval_hard_en | - | error: list index out of range (see res/cosyvoice3-latest/long_tts_eval_hard_en/zero_shot-log.txt) |
| tts | long_tts_eval_hard_zh | - | error: list index out of range (see res/cosyvoice3-latest/long_tts_eval_hard_zh/zero_shot-log.txt) |
Evaluation Commands
[1] python audio_evals/main.py --dataset seed_tts_eval_en --model cosyvoice3-latest --prompt cosyvoice3-vc
[2] python audio_evals/main.py --dataset seed_tts_eval_zh --model cosyvoice3-latest --prompt cosyvoice3-vc
[3] python audio_evals/main.py --dataset cv3_zero_shot_en --model cosyvoice3-latest --prompt cosyvoice3-vc
[4] python audio_evals/main.py --dataset cv3_zero_shot_zh --model cosyvoice3-latest --prompt cosyvoice3-vc
[5] python audio_evals/main.py --dataset cv3_zero_shot_hard_en --model cosyvoice3-latest --prompt cosyvoice3-vc
[6] python audio_evals/main.py --dataset cv3_zero_shot_hard_zh --model cosyvoice3-latest --prompt cosyvoice3-vc
[7] python audio_evals/main.py --dataset long_tts_eval_en --model cosyvoice3-latest --prompt cosyvoice3-tts
[8] python audio_evals/main.py --dataset long_tts_eval_zh --model cosyvoice3-latest --prompt cosyvoice3-tts
[9] python audio_evals/main.py --dataset long_tts_eval_hard_en --model cosyvoice3-latest --prompt cosyvoice3-tts
[10] python audio_evals/main.py --dataset long_tts_eval_hard_zh --model cosyvoice3-latest --prompt cosyvoice3-tts