Sony's new patent is revealed! Can the lip-sync system subvert game development?

　　In the past decade, AI and gaming technology have achieved rapid development, and major game companies have also competed to apply for extremely innovative patents. Today, a new patent from Sony may completely overturn our existing game development model.

Recently, Sony released a new patent that elaborates on a next-generation lip-sync system specially designed for gaming NPCs. With this system, it is easy to achieve a perfect match between translated lines and NPC mouth movements in multilingual versions.

This system has powerful evaluation functions, which can comprehensively evaluate the presentation effect of NPC mouth movements in all supported languages, and generate similarity scores for developers, providing valuable reference for the development process. Not only that, the system also includes an automated repair solution that can dynamically adjust the duration of the translated voice and the movement trajectory of the character's jaw, so as to accurately align with the timing rhythm of the original lines.

Sony said that the misalignment of NPC lip shape and localized voice will seriously damage the player's sense of immersion, which will lead to players' disappointment. The traditional manual adjustment method used in the past is not only time-consuming and labor-intensive, but also extremely inefficient. And this new technology is expected to free the development team from tedious and repetitive labor. If this technology can be successfully implemented in the end, it is very likely to significantly shorten the development time of the game.