Welcome! This month we’ll be introducing one of the world’s most popular online generative AI toolsets, runway.ml, as we generate a set of short video clips to assemble a short promotional video.
Project overview
As generative AI develops, we’re delving into apps and tools currently available to assist in creative projects. In this series, we’re going to use the video generation tools at runway.ml to create 10 short video clips to edit together to create a short promotional video for an upcoming conference. We’ll use chatGPT to suggest text for a script, then use Runway’s text-to-speech tool to create a realistic-sounding voiceover.
Note this is not an explainer series, though we do detail the main steps to follow at runway.ml
Here’s an example of the beginning of a short promotional video using only runway’s AI video generation and ‘text to speech’ tools:
What is runway.ml?
Runway.ml offers browser-based, AI-assisted tools to generate digital creative assets including images, short video clips and audio. You can sign-up for a free account and receive a limited number of credits to play with, while paid subscription tiers include credits and the option to buy additional credit packs as needed.
Runway’s video and audio tools
Below are examples of the runway features we’ll be using this month. Note that runway includes additional features we’re not covering in this series. See the website for more details!
A text prompt can be used to generate a short (4 second long) video clip:
You can also enter parameters to ‘control the camera view’ for the video clip. Below we’ve asked the camera to zoom in a little while also rising vertically:
You can also use a still image as the first frame of a generated video clip:
Runway includes dedicated video tools to accomplish common editing tasks including green-screen (background removal) and colour grading:
A selection of AI-enhanced audio tools are also available, including text-to-speech:
See runway.ml for details of all the tools. Those highlighted above will be used as part of this series as we create a short promotional video for a conference.
Join us in the next post when we use chatGPT to generate suggestions for shots to include in our short video!
