Researchers at Apple have unveiled Keyframer, a prototype generative AI animation tool that enables users to add motion to 2D images by describing how they should be animated.
Technology
Apple’s latest prototype AI tool can animate images using text descriptions
Researchers at Apple have unveiled Keyframer, a prototype generative AI tool that enables users to add motion to 2D images by describing how they should be animated.
In a research paper published on February 8th, Apple said that large language models (LLMs) are âunderexploredâ in animation despite the potential theyâve shown across other creative mediums like writing and image generation. The LLM-powered Keyframer tool is being pitched as one example of how the technology could be applied.
Utilizing OpenAIâs GPT4 as its base model, Keyframer can take Scalable Vector Graphic (SVG) files â an illustration format that can be resized without interfering with quality â and generate CSS code to animate the image based on a text prompt. You just upload the image, type something like âmake the stars twinkle,â in the prompt box, and hit generate. Examples provided in the research paper show how a Saturn illustration can transition between background colors, or show stars fading in and out of the foreground.
Users can produce multiple animation designs in a single batch, and adjust properties like color codes and animation durations in a separate window. No coding experience is necessary as Keyframer automatically converts these changes into CSS, though the code itself is also fully editable. This description-based approach is much simpler than other forms of AI-generated animation, which typically requires several different applications and some coding experience.
One professional motion designer who took part in Appleâs research said, âPart of me is kind of worried about these tools replacing jobs, because the potential is so high. But I think learning about them and using them as an animator â itâs just another tool in our toolbox. Itâs only going to improve our skills. Itâs really exciting stuff.â
Still, it has a long way to go. Keyframer isnât publicly available yet, and the user study within Appleâs research paper comprised just 13 people, who could only use two simple, pre-selected SVG images when experimenting with the tool.
Apple was also careful to mention its limitations within the paper, specifying that Keyframer focuses on web-based animations like loading sequences, data visualization, and animated transitions. By contrast, the kind of animation you see in movies and video games is far too complex to produce using descriptions alone â for now, at least.
Keyframer is one of several generative AI innovations that Apple has announced in recent months. In December, the company introduced Human Gaussian Splats (HUGS), which can create animation-ready human avatars from video clips. Last week, Apple also released MGIE, a new AI model that can edit images using text-based descriptions.