ChatGLM2+Voice Cloning+SadTalker ๐ŸŽถ

July 18, 2023 ยท View on GitHub

Chat with any character you like immersively through ChatGLM2-6B, FreeVC and SadTalker in real time ๐Ÿ“บ๐Ÿ’•๐Ÿป

็ฎ€ไฝ“ไธญๆ–‡

Easy to use ๐Ÿ’ก

(1) Run

git clone https://github.com/KevinWang676/ChatGLM2-Voice-Cloning.git
cd ChatGLM2-Voice-Cloning
pip install -r requirements.txt

(2) Run

sudo apt update && sudo apt upgrade
apt install ffmpeg

(3) Upload freevc-24.pth to the folder ./ChatGLM2-Voice-Cloning/checkpoint/. You can download freevc-24.pth through this link.

(4) Upload pretrained_bak_5805000.pt to the folder ./ChatGLM2-Voice-Cloning/speaker_encoder/ckpt/. You can download pretrained_bak_5805000.pt through this link.

(5) Run python app_en.py.

(6) Done! Now you can open Gradio interface and chat with any character you like through ChatGLM2-6B and voice cloning. ๐Ÿ’•

P.S. The code is based on ChatGLM2-6B, FreeVC, and SadTalker.

Quick start: HuggingFace Demo ๐Ÿค—

If you like the my application, please star this repository. โญโญโญ

Gradio Interface:

image