Discover How Namit Malhotra Unveils DNEG’s AI-Driven Lip-Sync Tech in the Ramayana English Trailer!
The English trailer for Nitesh Tiwari’s highly anticipated film, Ramayana: Part 1, has been unveiled by Sony Pictures, providing a glimpse into the epic tale set to captivate audiences worldwide. The trailer has garnered attention not only for its impressive scale and visual effects but also for the innovative technology used to synchronize the actors’ lip movements with the English dialogue. This approach marks a significant departure from traditional dubbing methods, aiming for a more authentic viewing experience.
Innovative Technology for Lip Synchronization
Unlike conventional dubbing, where a new voice track is simply layered over the original footage, Ramayana: Part 1 employs DNEG’s AI-powered technology to digitally adjust the actors’ mouth movements. Producer Namit Malhotra elaborated on this process, emphasizing that it begins with human performances. He noted that members of the principal cast contributed their own English voices, enhancing the emotional depth of the film.
“If you’ve seen that, where we’ve got tremendous praise, where we’ve actually brought in human actors, voice actors, who actually come in and performed the voice performances. Some of them actually are done by the actors themselves, who have a good command over the language and are able to emote appropriately in a different language,” Malhotra explained. He stressed the importance of this human-led approach, stating, “So we’ve done that as a first step to make sure that the rendering of that expression and emotion is authentic, and it’s led by humans. There is no AI whatsoever.”
The next phase involved human artists creating the foundation for the characters’ lip movements to align with the new voice performances. Malhotra clarified, “There is no AI whatsoever. We followed that up with what we’re calling, because we are trying to make the lip sync in line with the voice. So we have a next step, which is again done by humans, where you actually have people coming in, what we call a human driver that actually creates this foundation of how the lips actually move and how it syncs itself to the voice itself.”
The Role of AI in Final Adjustments
While the initial stages relied heavily on human input, AI technology played a crucial role in the final adjustments. Malhotra explained that the challenge extended beyond merely matching a voice to an actor; it also involved ensuring that the voice performance, facial appearance, and lip movements worked together seamlessly. “And it looks appropriate because the best voice actor may not have the right face for the actor on screen. So we are making sure that you’ve got the voice actors, we’ve got people whose faces and lips match the look of the actors,” he said.
The final stage utilized a bespoke technology tool developed specifically for this project. “And then we’re using bespoke technology tool that we’ve created, leveraging AI, to stitch that into the face of the actor so it feels absolutely seamless,” Malhotra added. He emphasized that the goal was to create an experience where audiences feel they are watching the original actors perform the English dialogue, rather than a typical dubbed version. “So when you’re now watching it, you feel like you’re watching them actually speak with that authenticity and emotion, whilst not being taken away by subtitles and, you know, dubs that never quite deliver what’s happening,” he stated.
Star-Studded Voice Cast
The English version of Ramayana: Part 1 features notable performances from the principal cast. Ranbir Kapoor lends his voice to Lord Ram, Yash portrays Ravana, and Sai Pallavi voices Sita. Their involvement adds a layer of authenticity to the film, as they have dubbed their own lines in English.
The trailer, which runs for just under four minutes, sets the stage for the central conflict of the story. It begins with Ravana’s rise to power and transitions into Lord Ram’s 14-year exile alongside Sita and Lakshman, played by Ravie Dubey. The trailer also introduces Rakul Preet Singh as Shurpanakha, culminating in Sita’s abduction and Ram’s vow to confront Ravana.
Observer Voice is the one stop site for National, International news, Sports, Editor’s Choice, Art/culture contents, Quotes and much more. We also cover historical contents. Historical contents includes World History, Indian History, and what happened today. The website also covers Entertainment across the India and World.
