Posted October 4, 2023 by fofr zsxkib In this blog post we’ll show you how to combine AnimateDiff and the ST-MFNet frame interpolator to create smooth and realistic videos from a text prompt. You can also specify camera movements using new controls.
You’ll go from a text prompt to a video, to a high-framerate video.
Your browser does not support the video tag.
Create animations with AnimateDiff
AnimateDiff is a model that enhances existing text-to-image models by adding a motion modeling module. The motion module is trained on video clips to capture realistic motion dynamics. It allows Stable Diffusion text-to-image models to create animated outputs, ranging from anime to realistic photographs.
