By CHRIS McGOWAN
The award-winning definitive authority on all things visual effects in the world of film, TV, gaming, virtual reality, commercials, theme parks, and other new media.
Winner of three prestigious Folio Awards for excellence in publishing.
By CHRIS McGOWAN
Immersive entertainment is selling out venues all over the world. Meow Wolf’s interactive psychedelic fun houses, Dreamscape’s full-roam multi-player VR adventures, immersive Van Gogh exhibits, and experiential art and entertainment are all part of a growing new ‘experience economy’ that involves both traditional and ‘immersive’ artists. It may transform malls, museums and theme parks along the way.
Those involved in these endeavors are mixing VR, AR, haptics, 3D projection mapping, motion capture, RFID cards and other technologies with older diversions to create new forms of art and entertainment, and building networks of venues to host successor immersive experiences.
The distinctive attractions were already surging in popularity before the pandemic and now are driving foot traffic as the appetite for live events explodes in a post-lockdown era. Like mega must-see art exhibitions of the past, the new immersive entertainment can be family friendly, serve as an original date or simply be a compelling excuse to get out of the house.
“People crave social experiences that they can’t replicate at home. Immersive entertainment fills a void that used to be filled by movie theaters. Modern audiences want experiences that are dynamic, interactive and shareable on social media. Immersive entertainment is the answer,” says Enklu CEO Ray Kallmeyer. Enklu operates The Unreal Garden and publishes VR/AR storytelling software.
Currently running in San Francisco and Denver, The Unreal Garden 2.0 is an augmented reality experience full of interactive art. The first version launched in 2018 and the updated edition followed two years later. With Microsoft’s HoloLens 2 headset, the viewer explores spaces that reveal digital art and augmented flora and fauna, including Android Jones’ fractal trees, Scott Musgrove’s jellyfish and John Park’s hummingbirds. According to Kallmeyer, Unreal Garden 2.0 runs on Enklu’s immersive storytelling platform. “The platform enables developers to ‘inload’ 3D content to physical rooms and create interactive narrative-driven experiences for cutting-edge immersive headsets like the HoloLens 2.”
Regarding the Vincent van Gogh experiences, Kallmeyer comments, “Immersive augmented reality, like the kind experienced in the Unreal Garden 2.0, is fundamentally different from the projections in experiences like the Immersive Van Gogh. In The Unreal Garden, holographic content fills the space around you and you can interact using hands or voice.”
Kallmeyer adds, “Enklu will continue to bring immersive augmented reality to the world by partnering with incredible artists like Android Jones as we open up more locations in select cities in the U.S. before going international in late 2022.”
Meow Wolf is an art collective that has constructed several unique and lucrative immersive venues, including House of Eternal Return in Santa Fe, New Mexico (2016), Convergence Station in Denver, Colorado (2021) and Omega Mart (2019) at the Area 15 complex in Las Vegas, Nevada. Set in a 20,000-square-foot space that once housed a bowling alley, House of Eternal Return is Meow Wolf’s flagship attraction, The group managed to purchase it thanks to an investment by fellow Santa Fe resident George R.R. Martin (Game of Thrones), who was named Chief World Builder by the collective four years later.
House of Eternal Return has over 70 rooms of immersive art and is full of secret passages and interactive light and objects. Guests make their way through the spaces while following a narrative about a family who disappeared after a forbidden experiment at their mansion. According to Rolling Stone magazine, House of Eternal Return was an instant sensation, drawing 400,000 visitors its first year. “Predicting the future of art or entertainment is very difficult at this point in time,” Martin told the magazine. “I don’t know what’s going to be here when the dust settles. But I think Meow Wolf has created enough that they may emerge as one of the big leaders in that area.”
“Storytelling entertainment has traditionally been a linear, non-interactive experience where audiences passively consume what a corporate entity curates for them. As technology has evolved, these experiences have only innovated in the way they are delivered to audiences – and they’ve stayed one-sided,” comments Meow Wolf CEO Jose Tolosa, formerly Chief Transformation Officer for Viacom/CBS.
Tolosa continues, “Meow Wolf has been an innovator since inception, as our artistic storytelling has always been non-linear and interactive. As guests visit our exhibitions, they navigate worlds on their own paths, which can be different every time, and interact with tech layers like RFID cards, laser-based puzzles and reactive projection mapping. Because our guests want to engage and participate more, we’re adding more digital doors as entry points to the Meow Wolf universe, allowing the physical and digital worlds to become alive with an ever-evolving story, just as they do in many digital video game worlds today.”
Tolosa explains, “In essence, we’re bringing a forward-looking physical entertainment experience to the digital realm and back again. Technology will allow the audience to create the story, to create the art and to create different paths through – maybe changing our understanding of story and art, but most certainly changing the way perspective can be viewed, altered and understood.” Meow Wolf is planning to launch another permanent installation this year in Washington, D.C.
VGR: VAN GOGH REALITY
Among the biggest stars of immersive entertainment are the various Van Gogh exhibits, produced by several different companies and staged in an estimated 100+ global venues. All use sophisticated projection mapping systems to bathe the viewer in Van Gogh’s paintings. This has led to some confusion when competing firms have shown immersive Van Gogh exhibitions in the same market.
In Paris, an exhibition called Van Gogh, Starry Night debuted in February 2019 at the Atelier des Lumières and was showcased in the Netflix show Emily in Paris. Lighthouse Immersive brought the show to North America, according to Leisha Bereson, Vice President of Marketing for Impact Museums, which co-produced the event in five locations. The creative team for the global version – Immersive Van Gogh – is creator Massimiliano Siccardi, composer Luca Longobardi and Creative Director of Animations Vittorio Guidotti, who were behind the Paris show.
Immersive Van Gogh, created by Lighthouse Immersive, opened in the U.S. in Chicago in February 2021. Designer David Korins (Hamilton) later joined the production. According to Bereson, Immersive Van Gogh has been shown in 26 cities to date across North America and Mexico. According to Panasonic.com, for the Immersive Van Gogh Toronto exhibit, 53 Panasonic PT RZ770 laser projectors were used with an internal network to create a 360-degree experience.
Lighthouse Immersive was also set to launch nine Immersive Frida Kahlo exhibits by mid-2022, co-producing five events with Impact Museums. “You can really see a great progression and comfort in building for unique spaces through the enhancements created for Immersive Frida Kahlo taken from cues in Immersive Van Gogh, meaning the walls provide a great sense of diversity in visual offerings and the floors are really animated and activated,” Bereson says. Meanwhile, Brussels-based Exhibition Hub bowed Van Gogh: The Immersive Experience for the first time in Naples, Italy (2018) and in the U.S. in Atlanta (2021). Exhibition Hub says it will have the experience in 25 cities globally by year’s end.
“The artist himself is the inspiration [for Van Gogh: The Immersive Experience],” according to Mario Iacampo, CEO of Exhibition Hub. “Van Gogh is a rock star of the art world. His life story and work are well-known and highly relatable. Van Gogh was a natural choice for this new type of presentation.”
Iacampo explains, “Exhibition Hub created and produced the entire concept for Van Gogh: The Immersive Experience, [which] utilizes 4K resolution technology provided exclusively by Barco to present its Immersive Gallery experience.” It is a 360-degree light and sound spectacular in an expansive room (typically 10,000 square feet, and 300,000 cubic feet of space) that brings more than 400 of Van Gogh’s works to life in a 35-minute digital presentation.
“The Immersive Gallery allows guests a unique opportunity to feel Van Gogh’s works wash over them,” Iacampo comments. “Barco’s visual display technology allows guests to step into Van Gogh’s paintings. Our unique experience is made possible by state-of-the-art video mapping technology, coupled with projections on the floor to create the impression of being enveloped in the art.” At the end of the show, there is also a 10-minute VR experience that allows guests to take a voyage through the French countryside to see Van Gogh’s inspirations.
Iacampo comments, “The public is looking for more transcendent experiences and deeper connections to iconic artworks and artists, and our immersive experiences deliver that. This is a new way to create and experience art. There is now room in the art world for these large-scale digital installations to interpret existing works and to create entirely new ones. Immersive art is here to stay and will join the more traditional methods of making art as another style in the artist’s palette.”
Iacampo adds, “We are continuing to develop new immersive art experiences, including ones focused on Claude Monet, Gustav Klimt, René Magritte, Frida Kahlo and Salvador Dalí. We are also focusing on family experiences that incorporate immersive technologies into more traditional exhibitions – think of your natural history museum’s dioramas coming to life all around you.”
Another major exhibit, Beyond Van Gogh: The Immersive Experience, is from Paquin Entertainment Group and Normal Studio, a projection-mapping outfit. Paquin is also teaming with the National Geographic Museum to present Beyond King Tut: The Immersive Experience in Washington, D.C. and Boston this year. Meanwhile, Grande Experiences, creators and producers of multi-sensory art and cultural experiences, claims to have presented the immersive show Van Gogh Alive in 70+ cities. The firm also has immersive experiences with Dali, Monet and Da Vinci.
Imagine Van Gogh: The Immersive Exhibition, conceived by Annabelle Mauger and Julien Baron, has appeared in about 10 cities, including five in Canada. Mauger staged the first immersive exhibit of the iconic Dutch painter’s work, Imagine Van Gogh, in 2008 in Cathedrale d’Images in Provence, France.
Dreamscape Immersive uses VR headsets, full-body mapping and motion capture technology to place six to eight users at a time in a full-roam virtual reality experience in a room-scale set. Current adventures include: Alien Zoo, The Blu: Deep Rescue and Men in Black: First Assignment, appearing at locations in Los Angeles, Dallas, Columbus, Paramus and Dubai. CEO Walter Parkes (former president of Amblin Entertainment and former head of the DreamWorks motion picture division) founded Dreamscape along with Kevin Wall (a global live-events producer), entrepreneur Ronald Menzel and Swiss computer scientists Caecilia Charbonnier and Sylvain Chagué. Investors have included Steven Spielberg, IMAX, Westfield Malls, AMC Theaters and Nickelodeon.
Other location-based VR attractions also offer immersion. Parkes comments, “What differentiates Dreamscape is the background of the people involved. On a technical level, our motion capture and inverse kinematic algorithms were developed by our Swiss partners whose background is in medical technology. This gives us a level of precision and reality not found elsewhere. On the content side, our team represents decades of experience in creating successful four-quadrant global entertainment in film, theme parks and music.
“All this,” he continues, “adds up to, we hope, a unique array of experiences which blur the line between movies, games and theme park attractions.” Parkes says the ‘full roam’ aspect of the experiences will always provide a greater stage and scale than what is possible with VR at home. He explains, “Not just because of the size of our stages, but because of the haptics and physical effects which are integral to Dreamscape experiences.”
Up to eight people can participate in the DreamWorks Dragons Flight Academy Adventure, a free-flying VR rescue mission in which each teammate has the chance to save the day. Parkes notes, “For most of our titles we’ve focused on six users – less due to the limitations of the technology and more because we’ve found that six users hit a sweet spot in terms of intimacy and shared experience.” He adds, “Men in Black [based on the movie series of which Parkes is the producer] is our most recent title, and is reflective of many of the techniques we’ve developed over the last few years.”
Parkes notes, “Dreamscape employs ‘sparse capture’ – meaning we only capture the position of our users’ hands, feet, back and head. From that our inverse kinematic algorithm can construct a ‘skeleton’ which is rendered as an avatar through which our audience experiences VR from the ‘inside out,’ in full contact with all of their senses. Because much of the process is accomplished algorithmically, we can accommodate up to eight users simultaneously without the latency or lag which plagues most other VR experiences.”
Regarding the visual effects of the project, Dreamscape has a core group of programmers, engineers and animators “who are largely responsible for everything we make. We also bring in independent contractors depending on the needs of any given project,” Parkes says.
Area 15 is an experiential arts and entertainment complex in Las Vegas where immersive art exhibits bump up against VR LBE and other interactive attractions. Area 15 has Meow Wolf’s Omega Mart, which contains interactive art, an interactive playground, a maze and portals to other worlds created by the likes of Brian Eno and Android Jones, as well as retail items for sale. Omega Mart had over a million visitors in its first year, according to the firm. Area 15 also contains Exhibition Hub’s Klimt: The Immersive Experience, Wink World: Portals to the Infinite (from Chris Wink, co-founder of the Blue Man Group), the Virtualis-VR LBE, and many other interactive and immersive attractions. Superblue (Miami), Seismique (Houston, created by Steve Kopelman, principal and COO of Escape the Room), ARTECHOUSE (Miami), Wisdome LA (Los Angeles), and Otherworld (Columbus) are other notable experiential entertainment attractions and/or immersive installations.
WHERE’S IT ALL HEADING?
As for what’s around the corner for immersive entertainment, Dreamscape’s Parkes comments, “At their best, these are compelling, unique entertainment experiences based on technologies which didn’t really exist until the last several years. The question is will they expand and become part of what we think of as ‘mainstream entertainment.’”