Karen Cheng is one of many creatives utilising AI as part of their idea generation process. Her recent fashion design project(opens in new tab) combines a few different AI models to get a smooth, automatic outfit switching catwalk video, and it's a true testament to how AI can benefit artists in such an immense way.
Her process first involved using Dall-E 2 to generate a whole bunch of designs over the top of some stills. By indicating the intended design area with the brush and feeding it a brief for each type of clothing, i.e. white overalls, Cheng was able to get some really interesting generated outfits. It even did an alright job of matching the lighting, though she did have to sift through a good deal of bad designs, like the «dress inspired by MC Escher» below.
So, the AI still isn't perfect for idea generation, but it got there in the end.
After the initial generation stage, Cheng ran the frames through EbSynth(opens in new tab) to make it work with video, and then through Depth-Aware Video Frame Interpolation software (DAIN(opens in new tab)) to smooth the frames out.
The final video came out spiffingly, and almost matches the professional level of Paul Trillo and Shyama Golden's incredible sci-fi fashion design project Cheng references in a later tweet(opens in new tab).
As usual the comments are filled with the expected barrage of AI worriers concerned that robots will displace humans, and put them out of creative jobs. A concern I must confess I briefly prescribed to myself.
When I spoke to David Holz, the founder of the Midjourney AI image generating Discord bot(opens in new tab), he had some pretty positive view on how the rise of AI is affecting creatives:
«When we invented cars, and all of a sudden cars
Read more on pcgamer.com