MiniMax H3 Locally with ComfyUI and ClipProj on 1 GPU

MiniMax H3 Locally with ComfyUI and ClipProj on 1 GPU

More

Summary

Fahd Mirza demonstrates running MiniMax H3, a large multimodal video generation model, completely locally using ComfyUI on a single H100 GPU. What distinguishes H3 from other video models is that it generates synchronized audio — breathing, ambient score, and dialogue — from a single text prompt in the same forward pass as the video frames, without requiring separate audio post-processing pipelines.

The setup walkthrough covers downloading four required model components from Hugging Face (diffusion model, UNet, VAE, and text encoder), placing them in the correct ComfyUI model directories, and loading the MiniMax text-to-video workflow template. Mirza generates several sample clips including a deep-sea thriller trailer and a handheld fire-and-steam scene, commenting on motion coherence, facial expressions, and audio synchronization. Total VRAM consumption on the H100 runs just over 54 GB end-to-end.

The most practically useful segment covers VRAM optimization via ClipProj: H3 ships with a 32-billion parameter text encoder that alone consumes roughly 15 GB of the 54 GB footprint. By cloning a custom ComfyUI node repository and swapping to a 4-billion parameter alternative, that cost drops to approximately 5 GB with minimal quality difference on the tested outputs. The video is a step-by-step reference for anyone wanting to run native audio-video generation locally rather than through MiniMax’s cloud API.


📺 Source: Fahd Mirza · Published August 10, 2026
🏷️ Format: Tutorial Demo

1 Item

Channels