Welcome! This month we introduce one of the world’s most popular online generative AI video production toolkits as we create a short promotional video for a new immersive experience.
The AI tools and models used in this series
We’ll use runway.ml to generate video clips and assemble them into a sequence, and we’ll use additional AI tools to help with initial ideation and to create text prompts to use at runway to help generate high quality video clips.
The main steps in the project:
- Add text titles and export the video file
- Generate an overview for an ‘immersive experience’ promotional video using perplexity.ai
- Generate still images using the flux-1.1-pro model at replicate.com to use as ‘first frame’ prompts at runway
- Generate short video clips using runway’s latest Gen-4 model
- Use runway’s online video editor to sequence the promotional video
- Use the speech-02-hd AI model at replicate.com to generate a realistic-sounding voiceover
- Use udio.com to generate a background music track
Part One: Ideation using perplexity.ai
Regardless of the field you work in, using GenAI for ideation if often a guaranteed timesaver when you’re faced with a blank screen hoping for inspiration. For this part of the project workflow we’ll use perplexity.ai, which provides text-based interaction a bit like ChatGPT and other ‘chat’ based AI applications. A FREE perplexity account allows a limited number of searches per day while a paid account includes access to its ‘best’ models and a deeper ‘research’ mode:
We start with a general text prompt for our short advert:
‘PROMPT: I need to block out a 30 second video promotional advert for an upcoming immersive experience’
THE FULL RESPONSE FROM PERPLEXITY
(You can see the start of it in the above screenshot):
Key Principles for a 30-Second Promo
- Focus on One Core Message: With only 30 seconds, deliver a single, clear message-what makes this immersive experience unique and why viewers should care38.
- Start with a Strong Hook: Capture attention in the first 2–3 seconds using a bold statement, intriguing question, or striking visual2.
- Show, Don’t Tell: Use dynamic visuals and motion graphics to convey the atmosphere and excitement, letting imagery do much of the storytelling134.
- Highlight the Experience: Briefly showcase key features-interactive elements, 360° visuals, or VR/AR moments-to immerse viewers even in this short format46.
- Clear Call to Action (CTA): End with a direct, easy-to-follow CTA (e.g., “Book Now,” “Experience More at [website],” or “Follow for Updates”)13.
- Keep Script Concise: Aim for 70–80 words (approx. 8–10 sentences) to fit the time limit and allow space for visuals and pacing13.
Storyboard Blockout (Scene-by-Scene)
| Time | Visuals / Actions | Voiceover / Text (Example) | Audio / SFX |
|---|---|---|---|
| 0:00–0:03 | Hook: Fast-paced montage of immersive visuals-people stepping into a vibrant, interactive environment (e.g., VR headsets, projection mapping, tactile displays). | “What if you could step inside the story?” | Ambient build-up, whoosh SFX |
| 0:03–0:08 | Reveal the Experience: Show signature moments-participants reaching out, reacting with awe, 360° camera spins, glimpses of the environment’s highlights. | “Welcome to [Experience Name]-where reality blurs with imagination.” | Uplifting, cinematic music rises |
| 0:08–0:15 | Features/Highlights: Quick cuts of interactive elements-touch, sound, movement; show diversity of participants (families, friends, individuals). | “Explore, interact, and lose yourself in a world designed to ignite your senses.” | Layered sound effects (laughter, interactive sounds) |
| 0:15–0:22 | Emotional Connection: Faces of wonder, laughter, and surprise; slow-motion shot of a key moment (e.g., a room transforming, a dramatic reveal). | “Every moment is unforgettable. Every step, a new adventure.” | Music swells, heartbeat or pulse SFX |
| 0:22–0:27 | Urgency/Exclusivity: Quick flashes of tickets, countdown, or “Limited Time Only” overlay. | “Tickets are limited. Don’t miss your chance.” | Music intensifies, subtle ticking |
| 0:27–0:30 | Call to Action: Logo animation, website, and social handle appear. | “Book now at [website]. Experience the extraordinary.” | Music resolves, memorable audio logo |
Tips for Execution
- Visual Style: Use high-contrast, vibrant colors and dynamic camera movements to evoke immersion45.
- Editing: Keep cuts quick but coherent; every frame should serve the story37.
- Audio: Layer in immersive sound design-ambient noises, crowd reactions, and a memorable music bed16.
- Customization: Prepare alternate versions for different platforms (vertical for Instagram Stories, horizontal for YouTube, etc.)3.
- Accessibility: Add subtitles to maximize reach and engagement3.
Sample Script (80 Words)
“What if you could step inside the story?
Welcome to [Experience Name]-where reality blurs with imagination.
Explore, interact, and lose yourself in a world designed to ignite your senses.
Every moment is unforgettable. Every step, a new adventure.
Tickets are limited. Don’t miss your chance.
Book now at [website]. Experience the extraordinary.”
This blockout ensures your 30-second promo is focused, visually compelling, and drives viewers to action, leveraging best practices for short-form, immersive marketing content.
Our thoughts
The example above was the first prompt we tried. The formatting of the reply, including the table, has been pasted in full. The level of detail provided based on such a short, generic prompt demonstrates how powerful dedicated tools like perplexity have become. We didn’t explicitly ask for a script or audio suggestions but it has provided them anyway. This should make it easier to create specific prompts for each shot when we start using runway.ml to generate the video clips.
In the next part of this series…
We’ll use perplexity to refine it’s suggestions for each individual shot into specific, detailed prompts to create images which can be used as the starting frames for each short video clip.
