ComfyUI EasyAnimate

February 12, 2025 · View on GitHub

Easily use EasyAnimate inside ComfyUI!

Arxiv Page Project Page Modelscope Studio Hugging Face Spaces

English | 简体中文

Installation

Option 1: Install via ComfyUI Manager

Option 2: Install manually

The EasyAnimate repository needs to be placed at ComfyUI/custom_nodes/EasyAnimate/.

cd ComfyUI/custom_nodes/

# Git clone the easyanimate itself
git clone https://github.com/aigc-apps/EasyAnimate.git

# Git clone the video outout node
git clone https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite.git
git clone https://github.com/kijai/ComfyUI-KJNodes.git

cd EasyAnimate/
pip install -r comfyui/requirements.txt

Download models into ComfyUI/models/EasyAnimate/

EasyAnimateV5.1:

7B:

NameTypeStorage SpaceHugging FaceModel ScopeDescription
EasyAnimateV5.1-7b-zh-InPEasyAnimateV5.130 GB🤗Link😄LinkOfficial image-to-video weights. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.
EasyAnimateV5.1-7b-zh-ControlEasyAnimateV5.130 GB🤗Link😄LinkOfficial video control weights, supporting various control conditions such as Canny, Depth, Pose, MLSD, and trajectory control. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.
EasyAnimateV5.1-7b-zh-Control-CameraEasyAnimateV5.130 GB🤗Link😄LinkOfficial video camera control weights, supporting direction generation control by inputting camera motion trajectories. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.
EasyAnimateV5.1-7b-zhEasyAnimateV5.130 GB🤗Link😄LinkOfficial text-to-video weights. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.

12B:

NameTypeStorage SpaceHugging FaceModel ScopeDescription
EasyAnimateV5.1-12b-zh-InPEasyAnimateV5.139 GB🤗Link😄LinkOfficial image-to-video weights. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.
EasyAnimateV5.1-12b-zh-ControlEasyAnimateV5.139 GB🤗Link😄LinkOfficial video control weights, supporting various control conditions such as Canny, Depth, Pose, MLSD, and trajectory control. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.
EasyAnimateV5.1-12b-zh-Control-CameraEasyAnimateV5.139 GB🤗Link😄LinkOfficial video camera control weights, supporting direction generation control by inputting camera motion trajectories. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.
EasyAnimateV5.1-12b-zhEasyAnimateV5.139 GB🤗Link😄LinkOfficial text-to-video weights. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports for multilingual prediction.
(Obsolete) EasyAnimateV5:
NameTypeStorage SpaceHugging FaceModel ScopeDescription
EasyAnimateV5-12b-zh-InPEasyAnimateV534 GB🤗Link😄LinkOfficial image-to-video weights. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports bilingual prediction in Chinese and English.
EasyAnimateV5-12b-zh-ControlEasyAnimateV534 GB🤗Link😄LinkOfficial video control weights, supporting various control conditions such as Canny, Depth, Pose, MLSD, etc. Supports video prediction at multiple resolutions (512, 768, 1024) and is trained with 49 frames at 8 frames per second. Bilingual prediction in Chinese and English is supported.
EasyAnimateV5-12b-zhEasyAnimateV534 GB🤗Link😄LinkOfficial text-to-video weights. Supports video prediction at multiple resolutions (512, 768, 1024), trained with 49 frames at 8 frames per second, and supports bilingual prediction in Chinese and English.
(Obsolete) EasyAnimateV4:
NameTypeStorage SpaceHugging FaceModel ScopeDescription
EasyAnimateV4-XL-2-InPEasyAnimateV4Before extraction: 8.9 GB / After extraction: 14.0 GB🤗Link😄Link
(Obsolete) EasyAnimateV3:
NameTypeStorage SpaceHugging FaceModel ScopeDescription
EasyAnimateV3-XL-2-InP-512x512EasyAnimateV318.2GB🤗Link😄LinkEasyAnimateV3 official weights for 512x512 text and image to video resolution. Training with 144 frames and fps 24
EasyAnimateV3-XL-2-InP-768x768EasyAnimateV318.2GB🤗Link😄LinkEasyAnimateV3 official weights for 768x768 text and image to video resolution. Training with 144 frames and fps 24
EasyAnimateV3-XL-2-InP-960x960EasyAnimateV318.2GB🤗Link😄LinkEasyAnimateV3 official weights for 960x960 text and image to video resolution. Training with 144 frames and fps 24

Node types

  • LoadEasyAnimateModel
    • Loads the EasyAnimate model
  • EasyAnimate_TextBox
    • Write the prompt for EasyAnimate model
  • EasyAnimateI2VSampler
    • EasyAnimate Sampler for Image to Video
  • EasyAnimateT2VSampler
    • EasyAnimate Sampler for Text to Video
  • EasyAnimateV2VSampler
    • EasyAnimate Sampler for Video to Video

Example workflows

Text to Video Generation

Our user interface is shown as follows, this is the json:

Workflow Diagram

Image to Video Generation

Our user interface is shown as follows, this is the json:

Workflow Diagram

You can run a demo using the following photo:

Demo Image

Video to Video Generation

Our user interface is shown as follows, this is the json:

Workflow Diagram

You can run a demo using the following video:

Demo Video

Camera Control Video Generation

Our user interface is shown as follows, this is the json:

Workflow Diagram

You can run a demo using the following photo:

Demo Image

Trajectory Control Video Generation

Our user interface is shown as follows, this is the json:

Workflow Diagram

You can run a demo using the following photo:

Demo Image

Control Video Generation

Our user interface is shown as follows, this is the json:

Workflow Diagram

You can run a demo using the following video:

Demo Video