Nvidia Uses AI To Render Virtual Worlds In Real Time

Nvidia is using artificial intelligence to draw new worlds without using traditional modeling techniques or graphics rendering engines. "This new technology uses an AI deep neural network to analyze existing videos and then apply the visual elements to new 3D environments," reports Tom's Hardware. From the report: Nvidia claims this new technology could provide a revolutionary step forward in creating 3D worlds because the AI models are trained from video to automatically render buildings, trees, vehicles, and objects into new 3D worlds, instead of requiring the normal painstaking process of modeling the scene elements. But the project is still a work in progress. As we can see from [this image], which was generated in real time on a Nvidia Titan V graphics card using its Tensor cores, the rendered scene isn't as crisp as we would expect in real life, and it isn't as clear as we would expect with a normal modeled scene in a 3D environment. However, the result is much more impressive when we see the real-time output in [this YouTube video]. The key here is speed: The AI generates these scenes in real time.

Re: Your first glimpse of matrix glitches

[tysonedwards]

They use AI *and* Unreal Engine 4 to render virtual worlds.

Re: Your first glimpse of matrix glitches

[Type44Q]

More specifically, they use AI for filling polygons rendered by UE4.

What the fuck? Not even close.

Re:

[Somebody Is Using My]

It seems more like the AI is procedurally generating the world, while the actual rendering is still using the Unreal 4 engine pipeline. It is impressive, but the title /is/ misleading.

Right now they apparently feed the AI video and it creates models and animations based off that video, which it then recombines into new worlds. Imagine this tech combined with GoogleEarth's library of images: it could create a fully-3D view of every street. It will be sort of like jumping from the old step-based Bards Tale g

Thanks for making me feel stupid!!

[MarkTina]

Whenever I see someone creating things like this it makes me realise how dumb I am in comparison! :-)

Re:Thanks for making me feel stupid!!

[110010001000]

We all were thinking that too. Man, Mark Tina is so dumb compared to this.

Like in real Life

[wolfheart111]

You folks dont exist until I go on slashdot... whos cat was that :)

Youtube video ending is scary.

[Anonymous Coward]

Its like the deepfakes. Make a movie of anyone doing anything.

My AI does it too

[nospam007]

Real time.
For a 100 year old oak, it only needs a hundred years, real time.

So that...

[MaryannG]

...was pretty damned impressive. Training sims will be a lot more effective anyway.

As Useful as FXAA

[BrendaEM]

If successful it would do little more rob people of a creative outlet and a living, for a lot of that stuff you saw in computer games was art, as well as bread-and-butter. What problem does it solve?

AI

[nasch]

Waiting for someone to comment "that's not AI", as always happens with any story about AI.

Re:

[q4Fry]

Waiting for someone to comment "that's not AI", as always happens with any story about AI.

Found the AI!