1. Workflow Overview

This workflow leverages the Hunyuan Video Model to generate dynamic videos from image references and text prompts, ideal for ads, creative clips, and multi-scene synthesis.

2. Core Models

• Main Model: hunyuan_video_custom_720p_fp8_scaled.safetensors

  • Function: Core video generation with frame interpolation and style transfer.

• VAE Model: hunyuan_video_vae_bf16.safetensors

  • Function: Decodes latent video frames with enhanced details.

• CLIP Models: clip_l.safetensors + llava_llama3_fp8_scaled.safetensors

  • Function: Multimodal text-image alignment for precise prompt control.

3. Key Nodes

1. HyVideoModelLoader

   • Role: Loads the Hunyuan model (supports bf16/fp8 precision).

   • Installation: Requires ComfyUI-HunyuanVideoWrapper plugin.

2. HyVideoVAELoader

   • Role: Loads the video-optimized VAE.

3. HyVideoSampler

   • Role: Controls video params (resolution 832x480, FPS 24, sampler FlowMatchDiscreteScheduler).

4. HyVideoEncode/Decode

   • Function: Encodes/decodes latent video frames with dynamic resolution.

5. VHS_VideoCombine

   • Role: Renders final video (MP4/H.264, CRF 19).

   • Installation: Requires ComfyUI-VideoHelperSuite.

6. ImageConcatMulti

   • Role: Concatenates multiple images for multi-subject scenes.

4. Workflow Structure (Groups)

• Parameter Group:

  • Sets resolution (e.g., 896x512), prompts (e.g., "Realistic, High-quality. a women holde the bag"), and negative prompts.

• Single-Subject Video Group:

  • Full pipeline: Model load → Text/Image conditioning → Sampling → Decoding → Rendering.

5. Inputs & Outputs

• Inputs:

  • Reference images (supports transparency, e.g., RMBG-1.4 background removal).

  • Text prompts, resolution, frame count (default 85).

• Output:

  • Video file (e.g., pl-custom_00001.mp4), H.264/MP4, 24fps.

6. Notes

1. Dependencies:

   • Download Hunyuan models and plugins (HunyuanVideoWrapper, VideoHelperSuite).

2. Hardware:

   • GPU ≥16GB VRAM recommended. Use bf16 for speed/quality balance.

3. Troubleshooting:

   • Choppy video? Reduce resolution or frame count.

   • Blurry output? Check VAE decode params or prompt specificity.