Along with real-time 3D, virtual reality and the metaverse, The London College of Fashion is enthusiastically embracing generative AI as a tool for the design and presentation of new ideas. They are working with Framestore to show the power of these new technologies to advance the culture of fashion. Johannes Saam, Framestore’s lead Generative Artist, Futurist and Creative Technologis joined Matthew Drinkwater (Head of Innovation) and Moin Roberts-Islam (Technology Development Manager) for a panel session at NVIDIA’s GTC event in San Francisco recently.
“We have been looking at the uses of generative AI for a while. For example, we had previously done a project using archival catwalk footage where we used AI to extract the motion data from the movement of the models which we then used with digital models and clothes in synthetic environments. This time we wanted to do something much more modern and cutting edge with what is possible today.”
Moin Roberts-Islam, Technology Development Manager, London College of Fashion
The Meta Catwalk
For this innovative demonstration of what generative AI can do for the fashion industry, Framestore combined Dreambooth, ControlNet, WarpFusion, DiscoDiffusion and Stable Diffusion with The Foundry’s VFX system Nuke to customise AI models to achieve something that is much richer than a straightforward style transfer operation.
The aim is to show a potential future where you could type in a designer’s name and a machine learning model would generate a new original catwalk fashion show, in a possible style of that designer.
The room space shown in the Meta Catwalk videos is entirely synthetic with a video clip of an audience composited in and created largely using Midjourney and Nuke.
For Framestore this project reflects a shift in approach to working with clients and being focused on experiences, and specifically Customer Experiences, User Interfaces and User Experiences and not just on VFX shots, with UIs being the shots, UXs how shots are achieved and CXs the bespoke experiences.
If you are interested in using generative AI and other forms of machine learning in your creative processes, Mondatum provides a range of services around the development of artificial neural networks (ANNs), machine learning model training and the use of AI to solve problems and streamline processes and workflows. For more information, contact John Rowe (john@mondatum.com) or Colin Birch (colin@mondatum.com).
Source: FXGuide