NVIDIA has introduced the latest version of its Broadcast app, aimed at improving the quality of live streaming and remote working through advanced AI-powered features. According to the NVIDIA Blogthe free application uses Tensor Cores on RTX GPUs to deliver professional-level audio and video enhancements.
The flow dream
Historically, high-quality live streaming required expensive hardware setups, often involving dual PC setups to handle gaming and encoding separately. NVIDIA Broadcast changes the game by using NVENC, a dedicated hardware video encoder on NVIDIA GPUs, which handles encoding tasks and ensures the rest of the system maintains optimal performance. This innovation is supported by popular streaming applications such as Open Broadcaster Software (OBS), enabling a new wave of broadcasters on platforms such as Twitch and YouTube.
In addition, NVIDIA Maxine offers free AI-powered features such as virtual green screens and webcam-based augmented reality tracking, eliminating the need for expensive physical equipment. These features debuted at TwitchCon 2019 and have since been integrated into the NVIDIA Broadcast app.
Now visible: NVIDIA Broadcast
NVIDIA Broadcast offers a range of AI-enhanced features designed to improve audio and video quality in various usage scenarios. Some of the key features are:
- Noise and Acoustic Echo Removal: AI eliminates unwanted background noise from both the microphone and incoming audio.
- Virtual backgrounds: Features like Background Removal, Replacement and Blur allow users to customize their backgrounds without expensive equipment.
- Eye contact: AI makes it appear as if a streamer is looking directly at the camera, even when that is not the case.
- Automatic frame: Dynamically tracks motion and automatically crops and zooms on moving objects.
- Vignette: Applies a darkening effect to the corners of the camera image for visual contrast and stylistic flair.
- Video noise removal: Removes visual noise in low light for a clearer image.
The app creates a virtual camera, microphone, or speaker in Windows, allowing users to set up their devices once and use them in multiple applications, including Discord, Google Meet, Microsoft Teams, OBS Studio, Slack, Webex, and Zoom. NVIDIA Broadcast’s AI networks run in real time on dedicated Tensor Cores found in NVIDIA GeForce RTX, TITAN RTX, NVIDIA RTX or Quadro RTX GPUs.
The technology behind NVIDIA Broadcast is also available as a software development kit for app developers. Companies like Elgato and independent developers have integrated these AI features into their products, further expanding the reach and usability of NVIDIA’s AI enhancements.
(Not) Hearing is believing
Since its release, NVIDIA Broadcast has gained widespread acceptance. Twitch personality Mr_Vudoo and YouTube host Unmesh Dinda have both praised the app’s capabilities. Dinda demonstrated the app’s noise-cancelling features under extreme conditions, showing its effectiveness even with loud background noise. Tom’s Hardware editor-in-chief Avram Piltch also tested the app and confirmed its ability to filter out various environmental noises.
NVIDIA Broadcast also proves useful for remote work. It enhances video calls by offering features such as background removal, which is well received by users in professional environments.
For more information and to download the app, visit NVIDIA broadcast page.
Image source: Shutterstock