Reallusion, a leading developer of 3D animation and content creation software, has unveiled a groundbreaking integration between its flagship products, Character Creator (CC) and iClone, and NVIDIA’s cutting-edge AI animation tool, Audio2Face (A2F). This innovative collaboration promises to redefine the landscape of multi-lingual facial lip-sync animation production, offering creators unparalleled efficiency and flexibility in their workflows.
The seamless integration between Character Creator, iClone, and NVIDIA’s Audio2Face leverages the power of AI animation technology to simplify the process of generating lifelike facial animations directly from audio input. This collaboration not only enhances A2F’s capabilities with a versatile cross-application character system but also amplifies facial editing functionalities, enabling users to export animations to leading 3D engines such as Blender, Unreal Engine, Unity, and NVIDIA Omniverse.
A2F, as an AI-powered application, excels in producing expressive facial animations solely from audio input. Unlike traditional solutions that are often limited to English-centric lip-sync, A2F stands out with its ability to generate animations in multiple languages, including songs and gibberish. With the introduction of Clair, a new deep-learning model tailored for female characters proficient in Asian languages, users now have access to even more diverse options for character animation.
The integration between Character Creator, Audio2Face, and iClone streamlines the animation workflow with complimentary plugins, enabling users to configure CC characters in A2F with just a single click. This automated process condenses the manual setup into a simplified step, allowing artists to witness lifelike talking animations synchronized with audio files instantly. Animations can then be seamlessly transferred back to iClone for further refinement before exporting to 3D tools and game engines.
Furthermore, the free A2F plugin for iClone enhances facial features and enables users to refine animations through dynamic interfaces. From adjusting expression strengths to fine-tuning tongue positions for precise enunciation, creators have full control over the animation refinement process. Additionally, iClone’s facial editing capabilities allow for further enhancements, including refined lip sync, natural expressions, and incorporation of head movement sourced from mocap equipment.
The integration of Character Creator, iClone, and Audio2Face represents a significant milestone in AI-driven animation technology, offering creators unprecedented flexibility and efficiency in their production workflows. The Character Creator Auto Setup plugin and iClone plugin are now available as free downloads from Reallusion, empowering creators to streamline their animation pipelines and unlock their creative potential.
This revolutionary integration opens new horizons for animation creators, promising smoother workflows, enhanced facial animations, and greater creative freedom in bringing characters to life.
