Choose topics other than NVIDIA’s new Events GPU, such as “Reflex” low latency gaming technology and “Broadcast” live streaming software.

After the conference in June 2020, Jensen Huang introduced new products and technologies in his home kitchen again this time.

As previously reported, on September 2, 2020, NVIDIA announced the “GeForce RTX 30” GPU series adopting the “Ampere” architecture at its own online event.
The highlight of the event, of course, is the new GPU, but the CEO of NVIDIAJensen huang(Jenson Huang) introduced various technologies in addition to GPUs and products that will be released in the future. Therefore, in this document, I would like to briefly introduce several announcements in addition to the new GPU.

It was also announced that the PC version of the popular Battle Royale FPS “Fortnite” supports GeForce RTX series real-time ray tracing and AI-based anti-aliasing technology “DLSS” (related article).

Related article

On September 2, 2020, NVIDIA announced as a product of the new “GeForce RTX 30” GPU series adopting the “Ampere” architecture at its own online event.「GeForce RTX 3080」When「GeForce RTX 3070」，「GeForce RTX 3090」Announced.

［09/02/2020 01:40］

• keyword:
• HARDWARE:GeForce RTX 30
• HARDWARE
• GPU
• GeForce
• NVIDIA
• News
• Editorial department:Toshiaki Konishi

Low latency “NVIDIA Reflex” technology and 360Hz compatible “G-SYNC Esports Display”

The first topic is technology related to lag reduction, especially considering esports.
The delays associated with computer games occur in several stages, such as keyboard and mouse input, hardware and software processing within a PC, and processing on the side of the display device, such as a screen or television. It is impossible to reduce all of these delays to zero, but if they can be shortened even a little, there is a chance that they will be advantageous, especially in competitive games where momentary operations can determine the outcome.

A slide that explains the importance of delay using “VALORANT” as an example. There is only 180 ms to shoot the enemy seen through space in the image. However, a general player needs a reaction time of about 150ms, so if the delay on the system side exceeds 30ms, the enemy cannot stop in this situation. If the delay on the system side can be shortened, the chances of winning increase.

To do this, it is necessary to measure the time from the user’s operation (input) until the result is reflected on the screen (output), and then find the bottleneck and take countermeasures. This time it was announcedNVIDIA Reflex(Nvidia Reflex, hereinafter Reflex) can be understood as a generic term that summarizes the technology for lag reduction in controller and game side software manufactured by NVIDIA and the technology to measure lag. This is not limited to the GeForce RTX series, but can also be used with the GeForce GTX 10 series.

In terms of software, by optimizing the rendering pipeline of the CPU and GPU, a lag of up to 50% can be achieved. Corresponding games include Fortnite, “VALORANT” and “Destiny 2”. For example, when playing Fortnite with GeForce GTX 1050, the lag around 120ms could be reduced to 50ms. Reflex technology will be introduced with the GeForce controller scheduled to be released in September 2020.

Reflex Says Software Enhancements Can Reduce Lags In Games By Up To 50%

On the other hand, regarding delay measurement technology, the “NVIDIA Reflex Latency Analyzer” measures the time it takes to detect the input and output of the mouse an image that reflects the operation, for example, the shooting light in FPS . (Hereinafter Reflex Latency Analyzer) will be developed and incorporated into the liquid crystal display for gamers.
NVIDIA has a gamers display that incorporates Reflex Latency Analyzer and supports a maximum vertical refresh rate of 360Hz.NVIDIA G-SYNC Sports Display(Hereafter referred to as G-SYNC Esports Screen) and attracts esports gamers.

G-SYNC e-sports display supports 360Hz high refresh rate display and also has a function to detect input by connecting a mouse and calculate the delay time from output on the screen side.

The G-SYNC Esports Display is scheduled to appear Fall 2020 from Acer, ASUSTeK Computer (ASUS), MSI, and Dell’s ALIENWARE brand. Also, ASUS, Logitech International, Razer, SteelSeries input devices support Reflex Latency Analyzer. However, it is not clear if a new product will appear with a corresponding input device or if an existing product will support the same function.

NVIDIA Broadcast – Add-on for Live Streaming Using GPU and AI Processing

The next topic is a software add-on for live streaming and video conferencing using GPU and AI processing.NVIDIA streaming(Hereinafter, Issuance). Release time is scheduled for September.

Broadcast is a feature for live announcers and users of video conferencing software.

Demonstration of noise removal. Even if you use a hair dryer behind the dispenser, it can only eliminate the noise.

It is not uncommon to find software that has the function of removing the background from the image of a person captured by a camera, or composing an arbitrary image or an image as a background. Broadcast uses edge AI processing running on the GeForce RTX series to remove microphone noise, remove backgrounds and blur, and blend it into any image.
In popular broadcasters’ live game, the station background is often seen to be removed and the video is composited into game video, but the same can be achieved with GeForce RTX series, webcam and the software. If so, there may be many people who want to try it even in their own situations.

By using Broadcast, you can easily remove the background from the dealer image captured by the webcam and combine it with an arbitrary image (left), or superimpose the dealer image on the game image (right). )

Omniverse machinima

The third topic is “NVIDIA Omniverse Machinima“(Omniverse Machinima) is a tool for the GeForce RTX series that can be used to create video jobs that use assets used in games, such as“ movie scenes ”displayed during gameplay and trailer videos. It is a motor. It is basically professional software, not something that players use directly.

Omniverse Machinima not only captures game assets and creates images, but also processes such as changing materials and lighting by ray tracing and adding human mouth movements and facial animation according to the sound of the series. GeForce RTX. It can be done using.

A slide showing the concept of Omniverse Machinima. Capture game assets, create a video by performing texture enhancement processing, adding lip sync to sound, adding effects, etc.

It is also possible to extract the movement of the person captured by the camera with AI processing and reflect it in the movement of the character.

Omniverse Machinima can be used with game engines like Unreal Engine, 3ds Max, Maya, Photoshop, video production, and photo editing software. You can sign up for early access on NVIDIA’s official website, so why not sign up if you’re interested?

Video demonstration with the material “Mount & Blade II: Bannerlord”. The siege battle over the fortified city was conducted by Omniverse Machinima.