​Metabuild Digital Human Services Platform 'R2MIX'

Metabuild's digital human service platform "R2MIX" means that it combines "Real-time" and "Reality." Metabuild provides services to utilize ultra-realistic Full-3D digital human beings in various fields through R2MIX.

R2MIX consists of "R2MIX LIVE," which can be used for video production and live streaming by synchronizing facial expressions and gestures of users and digital humans based on cameras, and "R2MIX AI," which can be used for AI-based customer response, guidance, and interpretation by applying interactive AI technology based on the ultra-large language model (LLM).

Digital human production services, which synthesize virtual faces made with existing AI into real human bodies, were not suitable for ordinary users or media creators to produce and utilize content in real time.

On the other hand, R2MIX LIVE provides a hyper-realistic digital human service that enables real-time synchronization and interaction between people and digital humans by recognizing users' facial expressions and gestures from real-time images obtained through smartphone cameras and expressing them with full-body 3D facial expressions, mouth shapes, and gestures.

Metabuild has developed its own Shader, Facial Rigging, and Blend Shape optimized for real-time rendering environments to express ultra-realistic digital humans in real-time. It also optimizes and provides everything from hairstyles to costumes and backgrounds to suit the real-time environment.

In particular, the company developed an interface that allows users to easily use digital human services, allowing users to create digital human  they want and create a metaverse space for content production with simple settings. Another big feature of R2MIX LIVE is that it allows high-quality real-time rendering videos to be transmitted to SNS broadcasting platforms such as YouTube and Instagram with low latency by utilizing Metabuild's network linkage middleware technology.

For this reason, R2MIX LIVE enables digital humans that replace users based on real-time rendering technology for live broadcasting, SNS, video conferencing, live shopping, remote lectures, and presentations, and has a wide range of applications such as entertainment, education, broadcasting, and shopping.

​

Metabuild has recently launched R2MIX AI products by combining 3D digital human implementation technology and AI technology accumulated so far. While the existing R2MIX LIVE was mainly optimized for creating and real-time streaming video content using digital humans, R2MIX AI is a digital human AI service that can interact with digital humans, guide them with necessary information on their own, and implement interpretation, counseling and response, and public services by combining AI platform technologies owned by the company and interactive AI technologies such as ChatGPT.​

Published: 31 Aug, 2023