VFX Voice

The award-winning definitive authority on all things visual effects in the world of film, TV, gaming, virtual reality, commercials, theme parks, and other new media.

Winner of three prestigious Folio Awards for excellence in publishing.

Subscribe to the VFX Voice Print Edition

Subscriptions & Single Issues


October 03
2022

ISSUE

Fall 2022

EXPERIENCING THE RISE OF IMMERSIVE ENTERTAINMENT

By CHRIS McGOWAN

Area 15’s The Portal features a 360° projection-mapped room, one of many immersive spaces in the Las Vegas complex. (Photo: Proto Images. Image courtesy of Area 15)

Area 15’s The Portal features a 360° projection-mapped room, one of many immersive spaces in the Las Vegas complex. (Photo: Proto Images. Image courtesy of Area 15)

Immersive entertainment is selling out venues all over the world. Meow Wolf’s interactive psychedelic fun houses, Dreamscape’s full-roam multi-player VR adventures, immersive Van Gogh exhibits, and experiential art and entertainment are all part of a growing new ‘experience economy’ that involves both traditional and ‘immersive’ artists. It may transform malls, museums and theme parks along the way.

Those involved in these endeavors are mixing VR, AR, haptics, 3D projection mapping, motion capture, RFID cards and other technologies with older diversions to create new forms of art and entertainment, and building networks of venues to host successor immersive experiences.

The distinctive attractions were already surging in popularity before the pandemic and now are driving foot traffic as the appetite for live events explodes in a post-lockdown era. Like mega must-see art exhibitions of the past, the new immersive entertainment can be family friendly, serve as an original date or simply be a compelling excuse to get out of the house.

“People crave social experiences that they can’t replicate at home. Immersive entertainment fills a void that used to be filled by movie theaters. Modern audiences want experiences that are dynamic, interactive and shareable on social media. Immersive entertainment is the answer,” says Enklu CEO Ray Kallmeyer. Enklu operates The Unreal Garden and publishes VR/AR storytelling software.

AUGMENTED ART

Currently running in San Francisco and Denver, The Unreal Garden 2.0 is an augmented reality experience full of interactive art. The first version launched in 2018 and the updated edition followed two years later. With Microsoft’s HoloLens 2 headset, the viewer explores spaces that reveal digital art and augmented flora and fauna, including Android Jones’ fractal trees, Scott Musgrove’s jellyfish and John Park’s hummingbirds. According to Kallmeyer, Unreal Garden 2.0 runs on Enklu’s immersive storytelling platform. “The platform enables developers to ‘inload’ 3D content to physical rooms and create interactive narrative-driven experiences for cutting-edge immersive headsets like the HoloLens 2.”

Regarding the Vincent van Gogh experiences, Kallmeyer comments, “Immersive augmented reality, like the kind experienced in the Unreal Garden 2.0, is fundamentally different from the projections in experiences like the Immersive Van Gogh. In The Unreal Garden, holographic content fills the space around you and you can interact using hands or voice.”

Kallmeyer adds, “Enklu will continue to bring immersive augmented reality to the world by partnering with incredible artists like Android Jones as we open up more locations in select cities in the U.S. before going international in late 2022.”

MEOW WOLF

Meow Wolf is an art collective that has constructed several unique and lucrative immersive venues, including House of Eternal Return in Santa Fe, New Mexico (2016), Convergence Station in Denver, Colorado (2021) and Omega Mart (2019) at the Area 15 complex in Las Vegas, Nevada. Set in a 20,000-square-foot space that once housed a bowling alley, House of Eternal Return is Meow Wolf’s flagship attraction, The group managed to purchase it thanks to an investment by fellow Santa Fe resident George R.R. Martin (Game of Thrones), who was named Chief World Builder by the collective four years later.

House of Eternal Return has over 70 rooms of immersive art and is full of secret passages and interactive light and objects. Guests make their way through the spaces while following a narrative about a family who disappeared after a forbidden experiment at their mansion. According to Rolling Stone magazine, House of Eternal Return was an instant sensation, drawing 400,000 visitors its first year. “Predicting the future of art or entertainment is very difficult at this point in time,” Martin told the magazine. “I don’t know what’s going to be here when the dust settles. But I think Meow Wolf has created enough that they may emerge as one of the big leaders in that area.”

The exterior of Area 15, an experiential arts and entertainment complex. (Photo: Laurent Velazquez. Image courtesy of Area 15)

The exterior of Area 15, an experiential arts and entertainment complex. (Photo: Laurent Velazquez. Image courtesy of Area 15)

The Vortex is an entrance to Area 15 where immersive art exhibits bump up against VR LBE and other interactive attractions. (Photo: Laurent Velazquez. Image courtesy of Area 15)

The Vortex is an entrance to Area 15 where immersive art exhibits bump up against VR LBE and other interactive attractions. (Photo: Laurent Velazquez. Image courtesy of Area 15)

Under the Experiential Frog Egg Garden in Meow Wolf’s Convergence Station, which opened in Denver in 2021. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

Under the Experiential Frog Egg Garden in Meow Wolf’s Convergence Station, which opened in Denver in 2021. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

Experiential C Street in Convergence Station is a promenade of vivid colors and concepts. Meow Wolf’s guests interact with tech layers, like RFID cards, laser-based puzzles and reactive projection mapping. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

Experiential C Street in Convergence Station is a promenade of vivid colors and concepts. Meow Wolf’s guests interact with tech layers, like RFID cards, laser-based puzzles and reactive projection mapping. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

Experiential C Street is a psychedelic delight for all ages in Meow Wolf’s Convergence Station in Denver. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

Experiential C Street is a psychedelic delight for all ages in Meow Wolf’s Convergence Station in Denver. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

Experiential C Street is a psychedelic delight for all ages in Meow Wolf’s Convergence Station in Denver. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

Experiential C Street is a psychedelic delight for all ages in Meow Wolf’s Convergence Station in Denver. (Photo: Jess Bernstein. Image courtesy of Meow Wolf)

“Storytelling entertainment has traditionally been a linear, non-interactive experience where audiences passively consume what a corporate entity curates for them. As technology has evolved, these experiences have only innovated in the way they are delivered to audiences – and they’ve stayed one-sided,” comments Meow Wolf CEO Jose Tolosa, formerly Chief Transformation Officer for Viacom/CBS.

Tolosa continues, “Meow Wolf has been an innovator since inception, as our artistic storytelling has always been non-linear and interactive. As guests visit our exhibitions, they navigate worlds on their own paths, which can be different every time, and interact with tech layers like RFID cards, laser-based puzzles and reactive projection mapping. Because our guests want to engage and participate more, we’re adding more digital doors as entry points to the Meow Wolf universe, allowing the physical and digital worlds to become alive with an ever-evolving story, just as they do in many digital video game worlds today.”

Tolosa explains, “In essence, we’re bringing a forward-looking physical entertainment experience to the digital realm and back again. Technology will allow the audience to create the story, to create the art and to create different paths through – maybe changing our understanding of story and art, but most certainly changing the way perspective can be viewed, altered and understood.” Meow Wolf is planning to launch another permanent installation this year in Washington, D.C.

VGR: VAN GOGH REALITY

Among the biggest stars of immersive entertainment are the various Van Gogh exhibits, produced by several different companies and staged in an estimated 100+ global venues. All use sophisticated projection mapping systems to bathe the viewer in Van Gogh’s paintings. This has led to some confusion when competing firms have shown immersive Van Gogh exhibitions in the same market.

In Paris, an exhibition called Van Gogh, Starry Night debuted in February 2019 at the Atelier des Lumières and was showcased in the Netflix show Emily in Paris. Lighthouse Immersive brought the show to North America, according to Leisha Bereson, Vice President of Marketing for Impact Museums, which co-produced the event in five locations. The creative team for the global version – Immersive Van Gogh – is creator Massimiliano Siccardi, composer Luca Longobardi and Creative Director of Animations Vittorio Guidotti, who were behind the Paris show.

Immersive Van Gogh, created by Lighthouse Immersive, opened in the U.S. in Chicago in February 2021. Designer David Korins (Hamilton) later joined the production. According to Bereson, Immersive Van Gogh has been shown in 26 cities to date across North America and Mexico. According to Panasonic.com, for the Immersive Van Gogh Toronto exhibit, 53 Panasonic PT RZ770 laser projectors were used with an internal network to create a 360-degree experience.

Lighthouse Immersive was also set to launch nine Immersive Frida Kahlo exhibits by mid-2022, co-producing five events with Impact Museums. “You can really see a great progression and comfort in building for unique spaces through the enhancements created for Immersive Frida Kahlo taken from cues in Immersive Van Gogh, meaning the walls provide a great sense of diversity in visual offerings and the floors are really animated and activated,” Bereson says. Meanwhile, Brussels-based Exhibition Hub bowed Van Gogh: The Immersive Experience for the first time in Naples, Italy (2018) and in the U.S. in Atlanta (2021). Exhibition Hub says it will have the experience in 25 cities globally by year’s end.

“The artist himself is the inspiration [for Van Gogh: The Immersive Experience],” according to Mario Iacampo, CEO of Exhibition Hub. “Van Gogh is a rock star of the art world. His life story and work are well-known and highly relatable. Van Gogh was a natural choice for this new type of presentation.”

Iacampo explains, “Exhibition Hub created and produced the entire concept for Van Gogh: The Immersive Experience, [which] utilizes 4K resolution technology provided exclusively by Barco to present its Immersive Gallery experience.” It is a 360-degree light and sound spectacular in an expansive room (typically 10,000 square feet, and 300,000 cubic feet of space) that brings more than 400 of Van Gogh’s works to life in a 35-minute digital presentation.

“The Immersive Gallery allows guests a unique opportunity to feel Van Gogh’s works wash over them,” Iacampo comments. “Barco’s visual display technology allows guests to step into Van Gogh’s paintings. Our unique experience is made possible by state-of-the-art video mapping technology, coupled with projections on the floor to create the impression of being enveloped in the art.” At the end of the show, there is also a 10-minute VR experience that allows guests to take a voyage through the French countryside to see Van Gogh’s inspirations.

Iacampo comments, “The public is looking for more transcendent experiences and deeper connections to iconic artworks and artists, and our immersive experiences deliver that. This is a new way to create and experience art. There is now room in the art world for these large-scale digital installations to interpret existing works and to create entirely new ones. Immersive art is here to stay and will join the more traditional methods of making art as another style in the artist’s palette.”

Iacampo adds, “We are continuing to develop new immersive art experiences, including ones focused on Claude Monet, Gustav Klimt, René Magritte, Frida Kahlo and Salvador Dalí. We are also focusing on family experiences that incorporate immersive technologies into more traditional exhibitions – think of your natural history museum’s dioramas coming to life all around you.”

The Galaxarium of the virtual reality experience Men in Black: First Assignment at Dreamscape Immersive. Steven Spielberg, IMAX, Westfield Malls, AMC Theatres and Nickelodeon are among the firm’s investors. (Image courtesy of Dreamscape Immersive)

The Galaxarium of the virtual reality experience Men in Black: First Assignment at Dreamscape Immersive. Steven Spielberg, IMAX, Westfield Malls, AMC Theatres and Nickelodeon are among the firm’s investors. (Image courtesy of Dreamscape Immersive)

House of Eternal Return has an otherworldly tree house and backyard along with 70 rooms of immersive art. Game of Thrones writer George R.R. Martin purchased the site for this first permanent Meow Wolf attraction. (Photo: Kate Russell. Image courtesy of Meow Wolf)

House of Eternal Return has an otherworldly tree house and backyard along with 70 rooms of immersive art. Game of Thrones writer George R.R. Martin purchased the site for this first permanent Meow Wolf attraction. (Photo: Kate Russell. Image courtesy of Meow Wolf)

In the House of Eternal Return, even a washing machine can serve as a portal. Meow Wolf now has several attractions, more being planned, and hundreds of employees. (Photo: Kate Russell. Image courtesy of Meow Wolf)

In the House of Eternal Return, even a washing machine can serve as a portal. Meow Wolf now has several attractions, more being planned, and hundreds of employees. (Photo: Kate Russell. Image courtesy of Meow Wolf)

Lighthouse Immersive was set to launch nine Immersive Frida Kahlo exhibits by mid-summer this year, with Impact Museums partnering in several locations. Laser projectors and an internal network create a 360-degree experience. (Photo: Kyle Flubacker. Image courtesy of Lighthouse Immersive and Impact Museums)

Lighthouse Immersive was set to launch nine Immersive Frida Kahlo exhibits by mid-summer this year, with Impact Museums partnering in several locations. Laser projectors and an internal network create a 360-degree experience. (Photo: Kyle Flubacker. Image courtesy of Lighthouse Immersive and Impact Museums)

Enhancements created for Lighthouse’s Immersive Frida Kahlo exhibit were taken from cues in the creation and development of Immersive Van Gogh. According to Leisha Bereson, Vice President of Marketing for Impact Museums, the exhibit walls provide a diversity of visuals and the floors are “animated and activated.” (Photo: Kyle Flubacker. Image courtesy of Lighthouse Immersive and Impact Museums)

Enhancements created for Lighthouse’s Immersive Frida Kahlo exhibit were taken from cues in the creation and development of Immersive Van Gogh. According to Leisha Bereson, Vice President of Marketing for Impact Museums, the exhibit walls provide a diversity of visuals and the floors are “animated and activated.” (Photo: Kyle Flubacker. Image courtesy of Lighthouse Immersive and Impact Museums)

Van Gogh: The Immersive Experience first debuted in the U.S. in 2021, produced by Exhibition Hub. Here, viewers are immersed in his painting The Starry Night. (Image courtesy of Exhibition Hub)

Van Gogh: The Immersive Experience first debuted in the U.S. in 2021, produced by Exhibition Hub. Here, viewers are immersed in his painting The Starry Night. (Image courtesy of Exhibition Hub)

The Unreal Garden 2.0, with locations in San Francisco and Denver, provides an augmented reality experience full of interactive art, which runs on Enklu’s immersive storytelling platform. (Image courtesy of the The Unreal Garden and Enklu, Inc.)

The Unreal Garden 2.0, with locations in San Francisco and Denver, provides an augmented reality experience full of interactive art, which runs on Enklu’s immersive storytelling platform. (Image courtesy of the The Unreal Garden and Enklu, Inc.)

Another major exhibit, Beyond Van Gogh: The Immersive Experience, is from Paquin Entertainment Group and Normal Studio, a projection-mapping outfit. Paquin is also teaming with the National Geographic Museum to present Beyond King Tut: The Immersive Experience in Washington, D.C. and Boston this year. Meanwhile, Grande Experiences, creators and producers of multi-sensory art and cultural experiences, claims to have presented the immersive show Van Gogh Alive in 70+ cities. The firm also has immersive experiences with Dali, Monet and Da Vinci.

Imagine Van Gogh: The Immersive Exhibition, conceived by Annabelle Mauger and Julien Baron, has appeared in about 10 cities, including five in Canada. Mauger staged the first immersive exhibit of the iconic Dutch painter’s work, Imagine Van Gogh, in 2008 in Cathedrale d’Images in Provence, France.

DREAMSCAPE

Dreamscape Immersive uses VR headsets, full-body mapping and motion capture technology to place six to eight users at a time in a full-roam virtual reality experience in a room-scale set. Current adventures include: Alien Zoo, The Blu: Deep Rescue and Men in Black: First Assignment, appearing at locations in Los Angeles, Dallas, Columbus, Paramus and Dubai. CEO Walter Parkes (former president of Amblin Entertainment and former head of the DreamWorks motion picture division) founded Dreamscape along with Kevin Wall (a global live-events producer), entrepreneur Ronald Menzel and Swiss computer scientists Caecilia Charbonnier and Sylvain Chagué. Investors have included Steven Spielberg, IMAX, Westfield Malls, AMC Theaters and Nickelodeon.

Other location-based VR attractions also offer immersion. Parkes comments, “What differentiates Dreamscape is the background of the people involved. On a technical level, our motion capture and inverse kinematic algorithms were developed by our Swiss partners whose background is in medical technology. This gives us a level of precision and reality not found elsewhere. On the content side, our team represents decades of experience in creating successful four-quadrant global entertainment in film, theme parks and music.

“All this,” he continues, “adds up to, we hope, a unique array of experiences which blur the line between movies, games and theme park attractions.” Parkes says the ‘full roam’ aspect of the experiences will always provide a greater stage and scale than what is possible with VR at home. He explains, “Not just because of the size of our stages, but because of the haptics and physical effects which are integral to Dreamscape experiences.”

Van Gogh: The Immersive Experience typically uses Barco 4K resolution technology to immerse participants. (Image courtesy of Exhibition Hub)

Van Gogh: The Immersive Experience typically uses Barco 4K resolution technology to immerse participants. (Image courtesy of Exhibition Hub)

Up to eight people can participate in the DreamWorks Dragons Flight Academy Adventure, a free-flying VR rescue mission in which each teammate has the chance to save the day. Parkes notes, “For most of our titles we’ve focused on six users – less due to the limitations of the technology and more because we’ve found that six users hit a sweet spot in terms of intimacy and shared experience.” He adds, “Men in Black [based on the movie series of which Parkes is the producer] is our most recent title, and is reflective of many of the techniques we’ve developed over the last few years.”

Parkes notes, “Dreamscape employs ‘sparse capture’ – meaning we only capture the position of our users’ hands, feet, back and head. From that our inverse kinematic algorithm can construct a ‘skeleton’ which is rendered as an avatar through which our audience experiences VR from the ‘inside out,’ in full contact with all of their senses. Because much of the process is accomplished algorithmically, we can accommodate up to eight users simultaneously without the latency or lag which plagues most other VR experiences.”

In The Unreal Garden 2.0, visitors wearing Microsoft HoloLens 2 headsets may experience awe and wonder around the next corner. (Image courtesy of the The Unreal Garden and Enklu, Inc.)

In The Unreal Garden 2.0, visitors wearing Microsoft HoloLens 2 headsets may experience awe and wonder around the next corner. (Image courtesy of the The Unreal Garden and Enklu, Inc.)

Regarding the visual effects of the project, Dreamscape has a core group of programmers, engineers and animators “who are largely responsible for everything we make. We also bring in independent contractors depending on the needs of any given project,” Parkes says.

AREA 15

Area 15 is an experiential arts and entertainment complex in Las Vegas where immersive art exhibits bump up against VR LBE and other interactive attractions. Area 15 has Meow Wolf’s Omega Mart, which contains interactive art, an interactive playground, a maze and portals to other worlds created by the likes of Brian Eno and Android Jones, as well as retail items for sale. Omega Mart had over a million visitors in its first year, according to the firm. Area 15 also contains Exhibition Hub’s Klimt: The Immersive Experience, Wink World: Portals to the Infinite (from Chris Wink, co-founder of the Blue Man Group), the Virtualis-VR LBE, and many other interactive and immersive attractions. Superblue (Miami), Seismique (Houston, created by Steve Kopelman, principal and COO of Escape the Room), ARTECHOUSE (Miami), Wisdome LA (Los Angeles), and Otherworld (Columbus) are other notable experiential entertainment attractions and/or immersive installations.

WHERE’S IT ALL HEADING?

As for what’s around the corner for immersive entertainment, Dreamscape’s Parkes comments, “At their best, these are compelling, unique entertainment experiences based on technologies which didn’t really exist until the last several years. The question is will they expand and become part of what we think of as ‘mainstream entertainment.’”


Share this post with

Most Popular Stories

AGING PHILADELPHIA FOR THE WALKING DEAD: THE ONES WHO LIVE
03 April 2024
VR/AR/MR Trends
AGING PHILADELPHIA FOR THE WALKING DEAD: THE ONES WHO LIVE
The final season of The Walking Dead: The Ones Who Live follows Rick Grimes and Michonne Hawthorne.
SINGING PRAISES FOR UNSUNG HEROES
15 April 2024
VR/AR/MR Trends
SINGING PRAISES FOR UNSUNG HEROES
Recognizing ‘hidden’ talent pivotal to making final shots a reality.
NAVIGATING LONDON UNDERWATER FOR THE END WE START FROM
05 March 2024
VR/AR/MR Trends
NAVIGATING LONDON UNDERWATER FOR THE END WE START FROM
Mahalia Belo’s remarkable feature directorial debut The End We Start From follows a woman (Jodie Comer) and her newborn child as she embarks on a treacherous journey to find safe refuge after a devastating flood.
THE CONSEQUENCES OF FALLOUT
15 April 2024
VR/AR/MR Trends
THE CONSEQUENCES OF FALLOUT
Westworld team brings Megaton Power to game adaption.
CINESITE GETS SNOWED UNDER BY TRUE DETECTIVE: NIGHT COUNTRY
27 March 2024
VR/AR/MR Trends
CINESITE GETS SNOWED UNDER BY TRUE DETECTIVE: NIGHT COUNTRY
True Detective: Night Country features a diverse cast including Jodie Foster.