GEN AI FILMMAKING
GEN AI FILMMAKING
PROJECT SERIES 02
01 Gen AI Music Video
For this project I wanted to create a dark fantasy music video using the latest Gen AI tools.
The music was first created in Suno and I was going for a more industrial sounding modular synth electronic track. I then refined the track in Ableton, piecing together sections and mixing the sound.
TOOLS: TOUCHDESIGNER - BLOB TRACKING PLUGIN - DAYDREAM PLAYGROUND - SUNO - DAVINCI RESOLVE - ABLETON - MIDJOURNEY - KLING AIThe realtime Gen AI visuals were then created in Daydream Playground with live prompting and adjustments to refine the visuals to fit the track.
I then created a series of images with an 80s dark fantasy aesthetic in Midjourney, which were subsequently animated in Kling to produce a series of short clips.
In the final phase I utilized blob tracking techniques in TouchDesigner and made the visual elements audio-reactive so they would actively sync to the beat. Final touches for visuals were implemented in DaVinci Resolve.
02 Gen AI Short Film
For this project the goal was to create an evocative short film using Gen AI tools and processes.
The process began with refining image prompts in Midjourney until I arrived at a particle style which was gritty and felt like a futuristic carnival on a forbidden planet. From there I crafted some voiceover text to help frame and shape the short.
TOOLS: MIDJOURNEY - KLING AI - DAVINCI RESOLVE - HAPPY EDITING - SUNO - ELEVEN LABS - ABLETONThe images were then animated into 5-15 second clips in Kling AI. Voiceover was crafted using Eleven Labs and helped shape the narrative. Music was created using Suno to give the piece more of a mood.
Once I had all the clips everything was edited to together and color-corrected within DaVinci Resolve. There I applied some Kodak film LUTS and 16mm grain to dirty up the image and make it less polished.