Join executive leaders at the Conversational AI & Intelligent AI Assistants Summit, presented by Five9. Watch now!
Replica Studios has launched early access to integrate its voice actor service into Unreal Engine’s MetaHuman Creator, enabling developers to create believable AI characters with realistic voices.
The Brisbane, Australia-based company is one of a number of startups that are using advances in AI to create voice-based products. Replica aims to save studios weeks of expensive voice-acting reshoots and script adjustments. The AI voice platform from Replica will enable well-timed lip-syncing for digital humans, and it will be on display at next week’s all-digital Game Developers Conference.
Replica’s high-quality AI character voices make voice production significantly easier for games and filmmakers. What it does is analyze an actor’s voice, and then it can produce variations on that voice, replicating the sounds of words the actor didn’t say or using a different emotional emphasis on words. The actor still gets paid for work, but they don’t have to come back over and over for reshoots.
Meanwhile, Unreal Engine’s MetaHuman Creator enables developers to create realistic-looking and moving artificial humans. The sound tech from Replica and facial animation from MetaHuman Creator will give developers a shot at easily creating realistic humans for their video games and films.
“Storytelling is an important form of human creative expression,” said Shreyas Nivas, CEO of Replica Studios, in an email to GamesBeat. “As a species we’ve been telling stories since the beginning of time. Over time the visual progression of storytelling has evolved, initially through the written word and now movies and video games. Software like Unreal Engine and Unity are doing a great job democratizing the visual side of storytelling.”
Above: Replica can reproduce a voice actor’s voice with words the actor didn’t say.
He added, “However, voice acting is still prohibitively expensive for most creators, despite how powerful the human voice is for creative expression. Think back to the dawn of human history, our ancestors would tell stories, and the way we do voice acting today isn’t all that different to how our ancestors might have done it.”
Replica’s platform enables game developers, animators, and filmmakers to use AI voices for digital characters. Additionally, Replica is creating a library of hundreds of AI voice characters with unique sounding voices for developers to tap into for game and animation narratives.
Developers can sign up for early access to the Replica Studios and MetaHuman Creator integration at this link. You can view a preview video showcasing MetaHuman Creator avatars performed by two of Replica Studios’ AI voice actors on this link.
I would say that video looks pretty realistic, but it’s not quite perfect, mostly due to the visuals falling short. Quality lip-syncing can make or break visual storytelling in games and digital content, and as developers add a cast of characters to a narrative, the lip-syncing challenge becomes all the more complex.
Replica Studios’ integration with Unreal Engine’s MetaHuman Creator provides developers from triple-A to indie studios with AI voice-acted characters in addition to accurate lip-synching and face animation, speeding up the animation process and freeing up more time for more creative experimentation with game narrative.
Developers can animate digital characters in minutes by capturing their own voice using a recording app, then using the audio to direct the performance of the AI voice, so that it matches with the face mocap and lip movements of the MetaHuman Creator, the company said.
This video above shows how the integration between Replica and MetaHuman Creator works.
Replica Studios will showcase its AI voice actors for MetaHuman Creator on Monday, July 19, from 2 p.m. to 2:30 p.m. Pacific
time. Nivas believes we’ll see a major transformation in the way game narratives are created and experienced by audiences. Traditionally, animators manually animate the face and lip movements to match the voiceover, which gets recorded separately. They often lose days or weeks to this process over the life of a project, while Replica’s Voice AI does it within minutes.
The aim is to lower the barrier to entry to creating better narrative-driven experiences within massive game worlds. Replica Studio has a library of 40-plus AI voice actors that range from expressive game characters to narrators and storytellers with a diverse range of accents and speaking styles. It also has Text to Synthesized Speech. You type what you want your avatar to say and receive the synthesized speech in seconds.
The company debuted in 2019. The company has 15 employees and it has raised $2.5 million.
GamesBeat
GamesBeat’s creed when covering the game industry is “where passion meets business.” What does this mean? We want to tell you how the news matters to you — not just as a decision-maker at a game studio, but also as a fan of games. Whether you read our articles, listen to our podcasts, or watch our videos, GamesBeat will help you learn about the industry and enjoy engaging with it.
How will you do that? Membership includes access to:
- Newsletters, such as DeanBeat
- The wonderful, educational, and fun speakers at our events
- Networking opportunities
- Special members-only interviews, chats, and “open office” events with GamesBeat staff
- Chatting with community members, GamesBeat staff, and other guests in our Discord
- And maybe even a fun prize or two
- Introductions to like-minded parties
Author: Dean Takahashi
Source: Venturebeat
