Wan2.2 Animate: Animation vs Replacement, Pose Retargeting, and Consent-Safe Character Motion

Two pipelines, not one magic character swap

In animation mode a static character image follows the movement extracted from a driving video. Replacement mode instead substitutes the character into existing video footage while trying to preserve the surrounding environment. These are distinct compositing problems: the first prioritizes pose correspondence, while the second also must preserve foreground and background occlusion. Choosing the wrong mode before preprocessing wastes computation and can damage the source scene.

What pose retargeting changes

Wan’s official preprocessing guide recommends pose retargeting in animation mode especially when the reference performer and desired character differ in body proportions. It expressly warns that the provided simple method is not guaranteed to work for all inputs. Replacement mode deliberately disables pose retargeting by default, because environmental interactions can be affected by different body proportions. A production pipeline should therefore expose retargeting as a mode-specific setting and compare intermediate skeleton renders before an expensive final output is generated.

Inspect the intermediate products

The repository’s preprocessing examples create source-face and source-pose video artifacts for animation; replacement adds background and mask video artifacts. These are diagnostically valuable, not merely temporary clutter. A visible error in segmentation or skeleton tracking often foreshadows a bad generated clip. Archive a preview of each intermediate along with the source assets’ hashes, selected FPS, aspect ratio and preprocessing parameters. If the driving performer leaves the frame, note that limitation before scheduling the full batch.

Mask shape is a trade-off

The official replacement guide describes mask dilation and contour options. A narrow mask can preserve more original background but can leave portions of the new character cropped or leaking. A larger mask gives the generator more space to accommodate changed body shape but can alter nearby objects, shadows or textures. Instead of copying a “best” mask setting from a tutorial, compare two candidates over difficult moments: arms crossing the torso, a chair interaction and an object passing behind the actor.

Local operation is not necessarily low cost

The source code and models can be downloaded from the official project, but that does not prove every workstation can render at delivery quality. The pipeline includes preprocessing checkpoints and a large animation generator; throughput depends on VRAM, precision, software environment and frame dimensions. This article intentionally does not invent an FPS throughput or universal cloud price. Keep checkpoint hashes, install revisions and licensing review in the manifest, and send pricing calculations to a local-cost worksheet rather than equating open weights with no expense.

Consent and impersonation safeguards

A driving performance may capture identifiable acting and voice; a target character may be a real person’s face. Both need documented reuse rights where applicable. Do not use motion transfer to make it appear that a real person performed actions they did not authorize. If the work is a fictional character, store actor and design permissions, label production roles and review whether the result could be mistaken for actual footage. Non-consensual lookalike and deceptive-editing risks are not solved by locally running an open checkpoint.

Worked production decision

For an animated museum presenter, use a fictional design approved by the illustrator and a consenting actor’s clean, full-body reference. Start with a short action that includes turning and gesturing, then inspect extracted pose and facial artifacts. Adjust retargeting only if the intermediate poses show proportion problems. Export a small draft, score hands, silhouette, scene continuity and unwanted camera drift, and keep the original performance unmodified in the archive. Use classic keyframe animation if the shots need exact hand contacts or consistent physical interaction.

Sources & Further Reading

• Alibaba Wan team — Wan2.2 repository (first-party source; checked 2026-10-25)
• Alibaba Wan team — Wan Animate preprocessing guide (first-party source; checked 2026-10-25)
• Alibaba Wan team — Wan2.2 generation entrypoint (first-party source; checked 2026-10-25)