Ever felt awkward with your gaze while engaging in a videoconference? Or feeling amused at someone else seemingly staring off camera when on a video call? The new NVIDIA Maxine will help correct such instances so that everyone looks good while attending a videoconference.
The GPU-accelerated AI platform will also let videoconference service providers improve streaming quality, deliver super resolution and enable face relighting and live captions.
Specifically, NVIDIA Maxine provides developers with a cloud-based suite of GPU-accelerated AI video conferencing software to enhance streaming video.
Videoconference service providers can take advantage of NVIDIA research in generative adversarial networks to offer features such as face alignment, which enables faces to be automatically adjusted so that people appear to be facing each other during a call.
Another AI-enabled feature is gaze correction, which helps simulate eye contact, even if the camera isn’t aligned with the user’s screen.
If callers don’t want to show themselves on screen, they can also choose their own avatars with real-time animation automatically driven by their voice and emotional tone.
An auto frame option allows the video feed to follow the speaker even if they move away from the screen.
Virtual asssistants answer questions
Powered by the NVIDIA Jarvis SDK, developers can add virtual assistants take notes, set action items and answer questions in human-like voices. Additional conversational AI services such as translations, closed captioning and transcriptions help ensure participants can understand what is being discussed on the call.
Instead of streaming the entire screen of pixels, NVIDIA Maxine nalyses key facial points of each person on a call and then intelligently re-animates the face in the video on the other side. This makes it possible to reduce bandwidth consumption down to 1/10 of the requirements of the H.264 streaming video compression standard.
“Videoconferencing is now a part of everyday life, helping millions of people work, learn and play, and even see the doctor. NVIDIA Maxine integrates our most advanced video, audio and conversational AI capabilities to bring breakthrough efficiency and new capabilities to the platforms that are keeping us all connected,” said Ian Buck, Vice President and General Manager of Accelerated Computing at NVIDIA.
Entelechy Asia 