Meta launches an AI project that transforms drawings into animations

Meta shared with the audience a artificial intelligence project which allows for animate your drawings: Animated Drawings. The company wants other developers to be able to create more fun and creative applications with Animated Drawings, which he launched as a project open source.

Meta Animated Drawings turns drawings into animations

Animated Drawings online tool works with drawings of humanoid characters. Users can upload their own sketches or choose an example from those featured on the site. If they agree to do it, Meta can use their designs to improve its models.

After fitting a frame to the drawing and having indicated the joints of the drawn character, the tool shows a animated version of the character. All through AI, in a way that seems almost magical – but it’s all technological. Users can choose from different animations from categories like dancing, funny, jumping and walking.

To animate the drawings, Animated Drawings uses artificial intelligence models to recognize objects, estimate the pose and segment the image. Then use computer graphics techniques to warp and move the image.

Since launching the demo, Meta has received permission to use more than 1.6 million images from users to train its models. Some people have tried uploading images of things other than humanoid characters, but the tool doesn’t work with them.

Meta decided to open source its AI-aided drawing project after having seen the variety and creativity of the images created by users. Many of them have asked for more features to add sounds and texts to their drawings. Meta also shared a dataset with about 180,000 drawings to encourage developers to experiment and improve the project. In her blog, Meta said he wanted to stimulate innovation and collaboration in the open source community.