This month we’ll be using runway to generate video clips for a promotional advert for a brand new immersive experience!
The future is immersive!
‘Elvis Evolution’ opens later this summer in London…
…and you’ve definitely heard about ABBA Voyage, which opened in 2023 and continues to wow audiences with its state of the art effects:
We’ve decided to revisit runway, a popular AI video generation toolkits, to see if it can help generate a video promo for our own immersive experience titled ‘Reality Remixed’!
Runway.ml one year on
We used runway.ml one year ago to create a short promotional video for a conference centre in London. This is how the ‘completed’ video looked in summer 2024:
The AI tools and models used in this series
We’ll use runway.ml to generate video clips and assemble them into a sequence, and we’ll use additional AI tools to help with initial ideation and to create text prompts to use at runway to help generate high quality video clips.
- Generate an overview for an ‘immersive experience’ promo video using perplexity.ai
- Generate still images using the flux-1.1-pro model at replicate.com to use as ‘first frame’ prompts at runway
- Generate short video clips using runway’s latest Gen-4 model
- Use runway’s online video editor to sequence the promotional video
- Use the speech-02-hd AI model at replicate.com to create a realistic-sounding voiceover
- Use udio.com to generate a background music track
- Add text titles and export the video file
The final video
Spoiler alert! Here’s a near-finished version of the video promo exported from runway towards the end of this series:
What IS runway.ml?
Runway.ml is a browser-based, generative AI media toolkit for creating and editing media assets including images, video clips and voice-based audio. You can start out with a free account to receive a limited number of credits to try it, while paid subscription tiers include a bundle of credits and the option to buy additional credits. Runway launched the latest evolution of their video generation models, ‘Gen 4’ in April 2025:
Join us for the first part of the series a few days from now. This series will continue throughout the month.
