Netflix has used AI in one form or another on some 300 of its titles, Lee Sung-gyun, the streamerโs senior director of APAC production, told an audience at the Busan International Film Festival.
On the same panel, โThe Outlawsโ director Kang Yoon-sung said AI workflows could take 30% to 40% off a feature filmโs production budget.
Lee shared the stage with Kang and Kimball Thurston, chief technology officer at Wฤtฤ FX, for โFilm Production and AI: New Tools, New Possibilities.โ Netflix and the MPA co-hosted the session. It was part of Creative Asia, the Netflix and BIFF program for emerging Asian talent. Film critic Yun Sung-eun moderated.
โAcross around 300 Netflix titles, AI has actually been put to use in various ways,โ Lee said. โItโs being used in previs, in production design, in working out set-dressing concepts ahead of time, in editorial, and of course in VFX.โ
Lee said new technology has always startled people when it arrives. โAll these technological changes and new tools have helped a great deal with the โhow,โ how we make what we make better, but they never decided the โwhy,โ why we have to tell this story,โ he said. โAI is the same.โ
He also screened a reel from Eyeline, Netflixโs VFX studio, about what the company calls hybrid production, which mixes live-action photography, VFX and generative tools. A second clip showed AI and VFX together producing large crowd scenes for the Netflix India title โGlory.โ Lee said that under tight budgets and schedules, those scenes would normally have had to be dropped.
Kang co-directed โRun to the Westโ with AI filmmaker Kwon Han-seul. The film opened in Korean cinemas last October and was billed as Koreaโs first feature to use AI across its entire production. Kang turned to AI there as a substitute for CG. โAt the time, AI technology was at a really rudimentary, low level, so we mainly used it for compositing and making creatures,โ he said. โAnd back then, even the creatures didnโt blend well with the footage weโd shot.โ In just a year, he said, AIโs quality has reached the point where using it commercially is no problem at all.
His test clip for โThe Gulf of Aden,โ a film built around military operations at sea, was made entirely with AI earlier this year using Kling, the Chinese software. Kang said the test was rendered at reduced quality. Current tools, he said, can output 4K at 10-bit color or higher, which is enough for cinemas.
An audience member asked about cost. โWhen we calculated how much weโd save on โThe Gulf of Adenโ for fundraising, it came to an actual reduction of around 40%,โ Kang said. โThatโs not just from replacing CG and VFX. The shoot itself got simpler, and it cut the overall production period to some extent.โ
Kang said AI has put projects that collapsed at the budget stage back on the table. That opens the door to genre and sci-fi films at a time when the Korean industry is struggling to grow. But he also said that because AI handles so much of the creative work, it often cuts out the discussion, effort and experience of many people that filmmaking has always relied on, leaving images made from one personโs ideas alone. โSo the quality of the footage AI makes is very high, but when it comes to delivering emotion and moving audiences, I think weโre in a period where it has actually gotten worse,โ he said.
Lee said he related strongly to Kangโs point. Some things now come out with a single click, he said, โbut when it comes to conveying emotion, ultimately a human has to touch it once more. I strongly agree that a human touch is absolutely essential.โ
Thurston described the deep learning denoiser behind his second Academy Scientific and Technical Award as โassistive AI.โ โIt is basically not allowed to change the creative intent in any way,โ he said. โIt touches pixels, but it only fixes them.โ
He said Wฤtฤ has used machine learning for at least a decade, or 20 to 25 years if you count early forms of Massive, the system it built for โThe Lord of the Rings.โ He also flagged gaps in color accuracy. โIf all your AI models have been trained on video images, youโre not getting the right red for a Coca-Cola can,โ Thurston said. โYou get Netflix red, but not Coca-Cola.โ
Asked how the companies keep pace with new models, Lee said Netflix works under strict internal guidelines and tests new tools before adopting them. โIf youโre asking about speed, Iโd like to say that weโre not wildly obsessed with it,โ he said. Thurston said Wฤtฤ is building an open-source tool through the Academy Software Foundation to track AI use and provenance, designed to link with initiatives such as C2PA.
On sustainability, Thurston said Wฤtฤโs data center in Wellington, New Zealand, which uses closed-loop cooling, now draws โzero liters of water per year.โ Lee said Netflix looks at sustainability company-wide, including its 2030 goal to cut carbon emissions, and doesnโt study AIโs impact separately.
Kang expects AI use to split in two directions. Short-form content will focus on productivity, and he pointed to China, where some short-form projects are made entirely with AI from planning to distribution. Film and drama will focus instead on credibility. He also showed footage from a feature animation he is developing, with photoreal backgrounds and animated characters he wants to move like live-action actors.
On replacing actors, Kang said it would be difficult. โNo matter how much AI technology advances, actors are creators who deliver emotion and move the audience,โ he said. โEven if AI acting becomes very sophisticated and imitates very precisely, emotion doesnโt come through because of its mechanical coldness.โ He sees AIโs role in stunt and stand-in work instead.
Thurston agreed. โThe point is not to replace actors, right? No way,โ he said. โWe are audiovisual storytellers, and storytelling is studying the human condition.โ
Lee closed the session by saying technology will keep changing, and surprising, even shocking, videos will keep coming out. โBut in the end, itโs humans who will write, and what we want more of is stories told by humans,โ he said.