When freeform tv drama Good Trouble returns to screens, fans will reconnect with the two young women, Callie and Mariana, trying to make it in Los Angeles. But instead of shooting scenes in downtown LA - an impossibility during the Covid-19 shutdown - filmmakers are digitally recreating the historic Palace Theatre and other landmarks on a set in Valencia.
By fusing the latest advances from the video game world, producers will shift much on-location shooting indoors to Santa Clarita Studios, projecting photo-real imagery of downtown's skyline on LED video walls.
"We are preparing all the virtual assets so that on Day One they can be as if they were shooting exterior LA but they will be on a set with limited people in Valencia," said Sam Nicholson, chief executive of Stargate Studios, which has partnered with the creators to create the virtual sets.
As Hollywood faces mounting pressure to resume production and reemploy hundreds of thousands of cast and crew who've been out of work for months, filmmakers are turning to virtual producers like Nicholson as a route to reboot TV shows and features halted by the pandemic. Some predict the health crisis will accelerate the industry's use of virtual filming to mitigate risks and reduces costs of on location shoots.
"It's the tip of the iceberg," Nicholson said. "People have to utilize these tools to get back online. Once they realize it's faster, better, cheaper, you will see a lot more virtual production coming down the pipeline."
"Once everybody agrees on the protocols that will allow us to get back to work, we just want to be able to maintain the creative freedom that we had before the shutdown, as much as possible," Fargnoli said.
"Not have scenes with only two people in a kitchen talking. We want to be as unhindered and unencumbered as possible and still be safe."
Producers expect that studios and producers in the coming weeks will need to comply with new protocols to prevent the spread of the coronavirus. Virtual production, they said, is one way to mitigate the risks.
"Once you take the machinery of that show and bring it out to successive locations, you are exponentially increasing your risk factor," said Fargnoli.
Virtual production isn't new. But thanks to the video gaming world, the technology has advanced well beyond the use of green screens, where actors perform in front of a blank screen that is green or blue and later replaced by an alternate background.
Instead of performing against a static, blank screen, actors and crew can interact in real-time within a 3D environment projected onto LED screens.
Walt Disney's hit show The Mandalorian, about an intergalactic bounty hunter, is a recent example of the possibilities of virtual technology.
Director Jon Favreau collaborated with Industrial Light & Magic, the special effects studio made famous for its work on Star Wars, and Epic Games and other technology companies, to create a six-meter-high, 270-degree semicircular LED video wall that eliminated the need for location shoots entirely.
On a stage, the filmmakers could recreate the dusty ochre tinged backdrop of a Tunisia-like world.
"To a lot of folks, virtual production can often sound like we are making Avatar," said Richard Bluff, visual effects supervisor for The Mandalorian.
About half of The Mandalorian's first season was shot against LED screens, Bluff said.
Sets can be lit and cameras track action as if in that environment, playing it back for the director in real-time, as opposed to having to wait for months after the shoot has wrapped to see the results typically created by visual effects artists after the fact. Backgrounds can be swapped out easily, avoiding costly sets.
But the technology isn't just being used to create fantasy worlds.
Nicholson highlighted the example of this year's HBO show Run, a drama set largely on a train. Stargate used its virtual system to create the views out of the windows of the train to give the impression that it was speeding along. The screens can also be operated remotely, reducing the number of crew on set.
Nicholson started his studio in 1989. When the September 11 terrorist attacks shuttered production on ER, Stargate jumped into action tracking across Chicago to capture 25 different locations and recreating the locations virtually so the actors could film against a backdrop rather than go out into the city.
Today, Stargate generates over US$26 million (HK$202.8 million) annual revenue and employs more than 150 artists, producers and technicians.
The growth has been fueled in part by rapid advances in technology borrowed from the gaming industry. Its proprietary system uses a free software known as Unreal Engine, produced by Epic Games.
Miles Perkins, who works in business development for Epic Games, said the Unreal Engine is being embraced by the film community in a way it hasn't in the past and interest is "extremely high."
A rival software known as Unity was used by Favreau to create a supposedly live-action Lion King, which included only one non-CGI shot.
"I've been in this business for a long time, since the beginning of the 90s," Perkins said. "For the first time, I'm having significant meaningful conversations with [studios] heads of physical production."
Virtual technology recently allowed the filmmakers for the Warner Bros' science-fiction movie Reminiscence due out next year to complete the post-production work through video calls rather than in screening rooms, said VFX supervisor Bruce Jones.
Jones said the new methods give an insight into how Hollywood may work in the future. Instead of traveling to a far-off location, which involves crews coming together from around the world, visual effects artists can spend months at the beginning of production to recreate those scenes for an actor to step into.
"One day you're shooting a desert scene and the next day you're shooting a scene in the Arctic and all you ended up doing was some costume changes, but it's still that same controlled environment that you are going to," he said.
Los Angeles Times