Nvidia-ai generates working driving simulator based on real images
It has been possible to use ai to create renders for a while now. Nvidia says it has achieved a breakthrough in this area. The company has succeeded in making the first video game demo with AI-generated graphics, based on existing video images.
Nvidia reports that it has trained the applied artificial intelligence on existing video images. The final demo is a simple driving simulator, where getting out or other interactions with the world are not possible. The graphics are also not great, but nevertheless the result is quite special.
According to The Verge, Nvidia’s software developers have partly based the AI on Pix2Pix. This open source system attempts to convert drawings into lifelike portraits and was created by developers at the University of Berkeley. In addition, Nvidia’s AI uses a generative adversarial network algorithm.
The rendering process starts with the collection of images. This is then divided into different frames, each with its own category, such as the trees, the sky and buildings. Then the generation adversarial network is allowed to analyze the frames, after which it generates its own version of the frames. Nvidia Tesla V100 GPUs have been used to train the AI; according to Nvidia, creating the driving simulator was not possible without Tensor cores.
In this way, the developers have created a virtual environment using an engine, in this case the Unreal Engine 4. The deep learning algorithms use this environment to generate graphics for each category in real time and apply them to the engine created by the engine. paste models.
A single, very powerful GPU was used to show the demo: the Titan V. Despite this, the frame rate remains at 25 frames per second and the textures change per frame due to the AI. It’s not very pretty to look at yet, but Nvidia emphasizes that the technology is still in its infancy. Bryan Cantazaro, vice president of Nvidia’s applied deep learning division, says it could be decades before it hits the market.