The Academy Software Foundation and the Advantages of Open Source Software

By CHRIS MCGOWAN

As visual effects have proliferated in the movie and TV industries, open source software (OSS)’s appeal and importance have steadily grown. As a result, the Academy of Motion Picture Arts & Sciences (AMPAS) teamed with the Linux Foundation in August 2018 to form the Academy Software Foundation (ASWF) to create and maintain free open source software for the industry and construct a healthy ecosystem for engineers and artists who want to contribute to this software. The VES is an Associate Member of the ASWF.

The origins of the ASWF trace back to when the AMPAS Science and Technology Council conducted a two-year survey into the use of OSS across the motion picture industry and discovered that almost 84% of the industry uses open source software, especially for animation and visual effects. AMPAS undertook the survey because it identified open source software OSS as a key strategic area for the motion picture industry.

Rob Bredow, Sr. Vice President, Executive Creative Director and Head of ILM, and Chair of the ASWF Governing Board

“Now that there is a clear path to inclusion for engineering work, we are seeing a large uptick in new code being written and older bugs fixed. It speaks volumes about the visibility that the Academy Software Foundation has brought to this important work, and the engineering talent that is looking to contribute to the future of filmmaking software.”

—Rob Bredow, Sr. Vice President, Executive Creative Director and Head of ILM, and Chair of the ASWF Governing Board

“Open source software is used in the creation of every film, and every frame of film is stored digitally in open source software formats – this software is critical infrastructure for both making and preserving movies,” says Rob Bredow, Sr. Vice President, Executive Creative Director and Head of ILM, and Chair of the ASWF governing board.

The initial investigation included an industry-wide survey, a series of one-on-one interviews with key stakeholders, and three Academy Open Source Summits held at the Academy headquarters, according to Andy Maltz, Managing Director, Science and Technology Council, AMPAS, and ASWF Board Member.

Comments Bredow, “They identified the key common challenges they were seeing with open source software. The first was making it easier for engineers to contribute to OSS with a modern software build environment hosted for free in the cloud. The second was supporting users of open source software by helping to reduce the existing version conflicts between various open source software packages. And the third was providing a common legal framework to support open source software.

“The mission of the Academy Software Foundation,” Bredow elaborates, “is to increase the quality and quantity of contributions to the content creation industry’s open source software base; to provide a neutral forum to coordinate cross-project efforts; to provide a common build and test infrastructure; and to provide individuals and organizations a clear path to participation in advancing our open source ecosystem.”

The ASWF has achieved solid early acceptance, with AWS (Amazon Web Services), Animal Logic, Autodesk, Blue Sky Studios, Cisco, DNEG, DreamWorks, Unreal Engine, Google Cloud, Intel, Microsoft, Movie Labs, Netflix, NVIDIA, Sony Pictures, Walt Disney Studios, Weta Digital, Foundry, Red Hat, Rodeo Visual Effects Company and Warner Bros. already on board.

WHERE ARE WE NOW?

Says Guy Martin, Director of Open Source Strategy at Autodesk and Board Member of the Academy Software Foundation: “OSS is the lifeblood of VFX departments in the context of how it enables them to use best-of-breed tools – and even write their own in-house applications – while seamlessly moving their effects and shots among these tools. Vendors like Autodesk have been asked why we support open source in the visual effects space. The answer is simple – our customers demand it. They use our tools like Maya and 3ds Max, but also a variety of other tools, and combine them in their tool pipelines to make great content. Any tool vendor or technology partner who is not participating in open source will be behind the innovation curve. There is healthy competition among many of the vendors and technology providers in this space, but there is also universal acceptance that open source is the ‘lingua franca’ that allows the industry to successfully share and collaborate.”

“We are no longer in the infancy of open source software and open standards within the movie, TV and VFX industries,” comments Steve Shapiro, Marvel Studios Director of Software and Production Technology. “Within VFX and post-production, we have been moving from a model of proprietary solutions toward collaborative standards. We are past the infancy of that migration, though there is still a long way to go before it is a mature practice.”

OPEN SOURCE ADVANTAGES

By having an open standard, everybody can contribute their development resources towards that, rather than having many different proprietary formats for common data and workflows, according to Jordan Thistlewood, Group Product Manager for Katana, Mari and Flix at Foundry. “It’s the idea that everyone is invested in a common technology that covers all the basics. This philosophy extends through many types of file formats throughout the industry, so everyone contributes to one massive technological pool,” Thistlewood comments in the essay “Open Standards Will Change the VFX Industry As We Know It” on Foundry.com.

Guy Martin, Director of Open Source Strategy at Autodesk and Board Member of the Academy Software Foundation

“Any tool vendor or technology partner who is not participating in open source will be behind the innovation curve. There is healthy competition among many of the vendors and technology providers in this space, but there is also universal acceptance that open source is the ‘lingua franca’ that allows the industry to successfully share and collaborate.”

—Guy Martin, Director of Open Source Strategy at Autodesk and Board Member of the Academy Software Foundation

Steve Shapiro, Marvel Studios Director of Software and Production Technology

The ASWF work is an excellent vehicle for healthy open source collaboration and adoption. They are supportive of other industry efforts by the VES and others because all of those groups are collaborating toward a common goal to standardize the areas of our industry that do not give anyone a competitive advantage.”

—Steve Shapiro, Marvel Studios Director of Software and Production Technology

“By sharing the code with a large number of engineers facing diverse challenges and allowing those engineers to improve the software and share it back to the community, we get better quality software. In addition, when you think of long-term preservation of data, sharing the algorithms for reading the data openly helps ensure the data is readable long into the future,” explains Bredow.

Maltz adds, “Long-term preservation of digitally-created motion pictures is a real challenge. How does one access a digital movie 100 years from now given the pace of technological innovation – and obsolescence? Standardized open source software APIs and file formats are key solutions to this challenge.”

“The most successful examples of open standards and software will improve the quality of life for large productions or post houses. VFX houses have to collaborate on shared shots and shared assets much more than ever before, which would be significantly harder without some standards,” says Shapiro.

Says Jim Jeffers, Sr. Principal Engineer and Sr. Director of Advanced Rendering and Visualization at Intel Corp., and ASWF Board Member, “Either for speed of development of compelling and complex assets or to take advantage of the latest state-of-the-art techniques in content development, it’s important to have interoperability and interchange become as seamless as possible. Through collaborative open source projects, the industry as a whole benefits from this kind of ‘standardization’ that still is changeable and tunable, which is a natural state for OSS.”

IDENTIFYING CHALLENGES

The AMPAS survey identified various challenges to the use of OSS, including siloed development, managing multiple versions of OSS libraries (“versionitis”), and varying governance and licensing models that need to be addressed in order to ensure a healthy open source community.

Shapiro observes, “Sharing technologies across studios has a variety of challenges, but open source standards do make it easier to collaborate on industry solutions to difficult problems. However, it is not a silver bullet because the standard is just the start. The adoption and evolution of those standards is crucial to their success. If a standard is not leveraged in the right places and improved to adapt to changes within the industry and technology, it will be antiquated before it is widely used.”

“Visual effects is still an innovative industry with a lot of shows breaking new ground each year. The really successful and widely adopted work we have seen in open source software has really been to provide useful core libraries for the basics – reading images, reading geometry, handling looks for shots – and that is key to get right. In terms of sharing something very complicated like a full rigged and groomed character, that’s not yet an area that we are seeing standardized due to the amount of innovation we are still seeing in the space,” says Bredow.

Sustainability, effective collaboration and clarity of purpose are challenges common to OSS projects, according to Daniel Heckenberg, R&D Supervisor – Graphics, Animal Logic, and Chair of the ASWF Technical Advisory Council (TAC). “The ASWF supports sustainability and collaboration by providing established and successful governance and process models for its projects. Key to these outcomes is the reduction of risks and barriers to entry for contributions and involvement through standardization of licensing and engineering resource commitments from members.”

LEGAL AND LICENSING

“The biggest complaints we heard from the community were around the wide variety of licensing requirements and some of the corporate requirements around adopting and contributing back to open source projects. Even free software has a cost if you need a team of lawyers to pick through obscure licenses in order to confirm you can leverage the tool for your next film. One of the ways the Academy Software Foundation can help is ensuring that our projects have common, permissible licenses that are easy for companies to review once and accept for their engineers and artists,” says Bredow.

Jim Jeffers, Sr. Principal Engineer and Sr. Director of Advanced Rendering and Visualization at Intel Corp., and ASWF Board Member

“Either for speed of development of compelling and complex assets or to take advantage of the latest state-of-the-art techniques in content development, it’s important to have interoperability and interchange become as seamless as possible. Through collaborative open source projects, the industry as a whole benefits from this kind of ‘standardization’ that still is changeable and tunable, which is a natural state for OSS.”

—Jim Jeffers, Sr. Principal Engineer and Sr. Director of Advanced Rendering and Visualization at Intel Corp., and ASWF Board Member

Andy Maltz, Managing Director, Science and Technology Council, AMPAS, and ASWF Board Member

“Long-term preservation of digitally-created motion pictures is a real challenge. How does one access a digital movie 100 years from now given the pace of technological innovation – and obsolescence? Standardized open source software APIs and file formats are key solutions to this challenge.”

—Andy Maltz, Managing Director, Science and Technology Council, AMPAS, and ASWF Board Member

ACCOMPLISHMENTS TO DATE

Adds Bredow, “One of the great things we have seen in our first year at the Academy Software Foundation is the tremendous increase in code contributions from a much larger number of contributors. In the past, many of these projects only had one or two main contributors, usually from one sponsoring company. Now that there is a clear path to inclusion for engineering work, we are seeing a large uptick in new code being written and older bugs fixed. It speaks volumes about the visibility that the Academy Software Foundation has brought to this important work, and the engineering talent that is looking to contribute to the future of filmmaking software.

“The first projects that the Academy Software Foundation have adopted are OpenColorIO, OpenVDB, OpenEXR, OpenCue and OpenTimelineIO,” says Bredow. “It’s important to note that the foundation is not a standards body and doesn’t act in that role. However, the nature of open source software often leads to de-facto industry standards, since many companies are already contributing to and using the software. So, when our software, like OpenEXR, gets wide adoption and becomes a de-facto industry standard, that’s great news too.”

OTHER OPEN SOURCE ECOSYSTEMS

“I think the ASWF work is an excellent vehicle for healthy open source collaboration and adoption,” notes Shapiro. “They are supportive of other industry efforts by the VES and others because all of those groups are collaborating toward a common goal to standardize the areas of our industry that do not give anyone a competitive advantage.”

The VFX Reference Platform, set up by the Visual Effects Society (VES), also works towards maintaining standards in this space. Initially focused on Linux only, the VFX Reference Platform is a set of tools and library versions to be used as a common target platform for building software for the VFX industry.

Comments Jeffers, “There is a pretty significant open source ecosystem that is related to but not directly managed by the AWSF. Intel is part of the ASWF to support the overall beneficial use of open source software, both the directly managed codes and the large ecosystem of OSS that is not yet an AWSF fit right now or that is standing strong as is. Liberally licensed codes like Intel’s Embree ray-tracing kernel library and our recently launched Open Image Denoise are becoming important tools for animation and VFX workflows. The Pixar-led Universal Scene Description (USD) OSS project for content and asset interchange is enabling multiple studios to collaborate and share the development and expertise of many to make a high-quality film or TV show. A robust mix of open source and advanced commercial software tools is now the norm for making modern films with digital assets.”

INDUSTRY ACCEPTANCE

“The Academy Software Foundation is really a broad industry effort. It’s always free to contribute to and use the software that is hosted by the foundation. And we are supported by members who provide engineering support and funding to ensure a successful foundation. In the first year, our membership base has almost doubled, and five open source projects have applied and been accepted into the foundation. We are seeing growing support for the foundation both at technical and management levels,” says Bredow.

More and more people are moving away from closed standards to open standards, says Thistlewood. “There’s now a proven track record of these projects, so there’s now faith in what they will become.”

“We have gone past the tipping point,” concludes Shapiro, “so it is no longer a question if open source software and standards are worthwhile. The question now is what fits within that model and how do we prioritize those efforts to bring them into the community.”

Daniel Heckenberg, R&D Supervisor – Graphics, Animal Logic, and Chair of the ASWF Technical Advisory Council

Jordan Thistlewood, Group Product Manager, Katana, Mari, Flix, Foundry