FIELD GUIDE

Wan2.2 Fun Control: Guide Generated Motion with Depth, Pose and Edge Maps

Some scenes fail because the generator imagines a different body pose or camera trajectory than the editor intended.

Structure can matter more than the prompt

Wan2.2 Fun Control is a ComfyUI-documented 14B workflow that uses structural guidance such as Canny edges, depth, pose, geometric line maps and trajectories. Unlike a text-only clip, these control inputs provide an explicit geometric signal from a source video or derived map. They are not magic: a contradictory prompt and control source can still produce deformed anatomy or unnatural motion.

Choose one control signal for the task

An edge map can guide high-contrast shapes but may preserve distracting outlines. Depth guidance helps maintain approximate spatial layout but does not encode the exact color or identity of an object. Pose input is a better fit for a character action, although it cannot fully specify cloth, hands or face. Trajectory guidance addresses broad movement, while detailed interaction still needs review. Begin with the smallest constraint set that solves the actual production defect.

Build a reproducible graph

The official tutorial separates the 14B high- and low-noise models and mentions fast-step LoRA options. Store the precise workflow, checkpoints and guidance-source extraction method with your shot ledger. If using third-party source video, ensure you have permission to derive motion information from it; an extracted skeleton or depth map does not automatically remove the source creator’s rights. Test licensing of each weight or model component rather than assuming all Wan forks share one agreement.

A practical animation sequence

An educational presenter must pick up a folder, rotate toward a desk and sit. Build a simple approved source move and compute the required control map. Render a short draft, then inspect the folder’s path, feet contact and consistent hand count. If motion transfer yields convincing movement but an inaccurate person, prioritize identity consent and subject reference through another explicitly authorized pathway. In editing, cut around unsafe or implausible transitions rather than presenting a physically false demonstration.

Different from character replacement

ComfyUI separately describes Wan2.2 Animate, which offers Mix for replacing a character and Move for animating from motion. Fun Control’s structural guidance is a different conceptual operation. Keep separate model and revision IDs in the capability matrix. Do not import unverified claims about commercial availability, render speed, resolution or cloud credits from one mode into another. Those facts require task-specific documentation.

Relevant alternatives and trade-offs

For authored first/last-frame interpolation try the Wan2.2 Fun InP workflow; for exact frame-by-frame motion, a traditional animation rig or physical video shoot remains more predictable.

Sources & Further Reading

CONTINUE EXPLORINGExplore related files ↗