On September 19, Alibaba unveiled its groundbreaking open-source motion generation model, Tongyi Wanxiang Wan2.2-Animate. This innovative model offers two distinct operational modes: animation and replacement. To animate a character, users simply need to input an image of the character along with a reference video. The model then seamlessly transfers the motions and expressions from the video onto the static image character, infusing it with dynamic vitality. Additionally, the model is capable of substituting the character in the video with the one from the image, all while preserving the original motions, expressions, and surrounding environment of the video.

This versatile model supports the animation of photographs featuring people, animated characters, and even animals. Its wide-ranging applicability makes it an invaluable tool in diverse fields, including short video creation, dance template generation, and animation production, streamlining the creative process and opening up new avenues for artistic expression.