OpenAI’s Sora just made another brain-melting music video and we’re starting to see a theme
Is flying through strange dreamscapes a new video trope?
When you purchase through links on our site, we may earn an affiliate commission.Here’s how it works.
OpenAI’s text-to-video tool has been a busy bee recently, helping to make ashort film about a man with a balloon for a headand giving us aglimpse of the future of TED Talks– and now it’s rustled up its first official music video for the synth-pop artist Washed Out (below).
This isn’t the first music video we’ve seen from Sora – earlier this month we sawthis one for independent musician August Kamp– but it is the first official commissioned example from an established music video director and artist.
That director is Paul Trillo, an artist who’s previously made videos for the likes of The Shins andshared this new one on X (formerly Twitter). He said the video, which flies through a tunnel-like collage of high school scenes, was “an idea I had almost 10 years ago and then abandoned”, but that he was “finally able to bring it to life” with Sora.
It isn’t clear exactly why Sora was an essential component for executing a fairly simple concept, but it helped make the process much simpler and quicker. Trillo points to one of his earlier music videos,The Great Dividefor The Shins, which uses a similar effect but was “entirely 3D animated”.
As for how this new Washed Out video was made, it required less non-Sora help than the Shy Kids’Air Headvideo, whichinvolved some lengthy post-productionto create the necessary camera effects and consistency. For this one, Trillo said he used text-to-video prompts in Sora, then cut the resulting 55 clips together in Premiere Pro with only “very minor touch-ups”.
The result is a video that, likeSora’s TED Talks creation(which was also created by Trillo), hints at the tool’s strengths and weaknesses. While it does show that digital special effects are going to be democratized for visual projects with tight budgets, it also reveals Sora’s issues with coherency across frames (as characters morph and change) and its persistent sense of uncanny valley.
Like the TED Talks video, a common technique to get around these limitations is the dreamy fly-through technique, which ensures that characters are only on-screen fleetingly and that any weird morphing is a part of the look rather than a jarring mistake. While it works for this video, it could quickly become a trope if it’s over-used.
Get the best Black Friday deals direct to your inbox, plus news, reviews, and more.
Sign up to be the first to know about unmissable Black Friday deals on top tech, plus get all your favorite TechRadar content.
A music video tradition
Music videos have long been pioneers of new digital technology – theDire Straits video forMoney For Nothingin 1985, for example, gave us an early taste of 3D animation, whileMichael Jackson’sBlack Or Whiteshowed off the digital morphing trick that quickly became ubiquitous in the early 90s (seeTerminator 2: Judgement Day).
While music videos lack the cultural influence they once did, it looks like they’ll again be a playground for AI-powered effects like the ones in this Washed Out creation. That makes sense because Sora, which OpenAI expects to release to the public “later this year”, is still well short of being good enough to be used in full-blown movies.
We can expect to see these kinds of effects everywhere by the end of the year, from adverts to TikTok promos. But like those landmark effects in earlier music videos, they will also likely date pretty quickly and become visual cliches that go out of fashion.
If Sora can develop at the same rate as OpenAI’s flagship tool,ChatGPT, it could evolve into something more reliable, flexible, and mainstream – withAdoberecently hinting that the tool could soon be a plug-in for Adobe Premiere Pro. Until then, expect to see a lot more psychedelic Sora videos that look like a mashup of your dreams (or nightmares) from last night.
You might also like…
Mark is TechRadar’s Senior news editor. Having worked in tech journalism for a ludicrous 17 years, Mark is now attempting to break the world record for the number of camera bags hoarded by one person. He was previously Cameras Editor at both TechRadar and Trusted Reviews, Acting editor on Stuff.tv, as well as Features editor and Reviews editor on Stuff magazine. As a freelancer, he’s contributed to titles including The Sunday Times, FourFourTwo and Arena. And in a former life, he also won The Daily Telegraph’s Young Sportswriter of the Year. But that was before he discovered the strange joys of getting up at 4am for a photo shoot in London’s Square Mile.
How to delete a character from Character AI
How to turn off Meta AI
Belkin’s Travel Bag for Vision Pro has pockets and is way cheaper than Apple’s own case