This month we’re going to use runway to generate video clips to include in a promotional advert for a new immersive experience!
In a happy coincidence of timing, the 4th Runway Ai Film Festival is currently LIVE!
If you happen to be near New York or LA later this month, you can get your tickets now!
In other AI news, the WIAFF (World AI film festival) winners were announced at the end of last month:
You can watch the ‘Best Waiff Film’, Costa Verde, below, and see all the winning submissions:
The future (and the present) is immersive!
This month we’re using runway, a popular AI video generation toolkit, to see if it can generate a video promo for our own upcoming immersive experience titled ‘Reality Remixed’!
The AI tools and models used in this series
We’ll use runway.ml to generate video clips and assemble them into a sequence, and use additional AI tools to help with ideation and to create text prompts to use with runway to help generate high quality video clips.
- Generate an overview for an ‘immersive experience’ promo video using perplexity.ai
- Generate still images using the flux-1.1-pro model at replicate.com to use as ‘first frame’ prompts at runway
- Generate short video clips using runway’s Gen-4 model
- Use runway’s online video editor to sequence the promotional video
- Use the speech-02-hd AI model at replicate.com to create a realistic-sounding voiceover
- Use udio.com to generate a background music track
- Add text titles and export the video file
The completed promo video
Spoiler alert! Here’s a near-complete version of the video promo exported from runway near the end of this series:
What IS runway.ml?
Runway.ml is a browser-based, generative AI media toolkit for creating and editing media assets including images, video clips and voice-based audio. You can start out with a free account to receive a limited number of credits to try it, while paid subscription tiers include a bundle of credits and the option to buy additional credits. Runway launched the latest evolution of their video generation models, ‘Gen 4.5’, in December 2025:
