A while ago I spotted someone working on real time AI image generation in VR and I had to bring it to your attention because frankly, I cannot express how majestic it is to watch AI-modulated AR shifting the world before us into glorious, emergent dreamscapes.
Applying AI to augmented or virtual reality isn't a novel concept, but there have been certain limitations in applying it—computing power being one of the major barriers to its practical usage. Stable Diffusion image generation software, however, is a boiled-down algorithm for use on consumer-level hardware and has been released on a Creative ML OpenRAIL-M licence. That means not only can developers use the tech to create and launch programs without renting huge amounts of server silicon, but they're also free to profit from their creations.
I was awoken in the middle of the night to conceptualize this project
ScottieFoxTTV(opens in new tab) is one creator who's been showing off their work with the algorithm in VR on twitter. «I was awoken in the middle of the night to conceptualize this project,» he says. As a creator myself, I understand that the Muses enjoy striking at ungodly hours.
What they brought to him was an amalgamation of Stable Diffusion VR and TouchDesigner(opens in new tab) app-building engine, the results of which he refers to as «Real-time immersive latent space.» That might sound like some hippie nonsense to some, but latent space is a concept fascinating the world right about now.
At a base level, it's a phrase that in this context describes the swelling potential that artificial intelligence brings to augmented reality as it pulls ideas together from the vastness of the unknown. While it's an interesting concept, it's one for a feature at a
Read more on pcgamer.com