Nvidia Uses Neural Network to Render 3D Environments

Discussion in 'HardForum Tech News' started by AlphaAtlas, Dec 3, 2018.

  1. AlphaAtlas

    AlphaAtlas [H]ard|Gawd Staff Member

    Messages:
    1,713
    Joined:
    Mar 3, 2018
    Nvidia claims they've developed software that can take a series of input videos, and generate a unique, but visually similar 3D representation of the world depicted in them. While Unreal Engine 4 is used somewhere in the process, the heart of the software is a neural network that can extract a "high-level descriptions of a scene" from footage and fill in the details. The company created a demo out of city driving footage, and claims it "allows attendees to navigate a virtual urban environment that is being rendered by this neural network."

    Check out the rendering tech in the video here.

    This AI breakthrough will allow developers and artists to create new interactive 3D virtual worlds for automotive, gaming or virtual reality by training models on videos from the real world. This will lower the cost and time it takes to create virtual worlds. The work was developed by a team of NVIDIA researchers led by Bryan Catanzaro, Vice President of Applied Deep Learning at NVIDIA... For training, the team used NVIDIA Tesla V100 GPUs on a DGX-1 with the cuDNN-accelerated PyTorch deep learning framework, and thousands of videos from the Cityscapes, and Apolloscapes datasets.
     
    oldmanbal likes this.
  2. Ultima99

    Ultima99 [H]ardness Supreme

    Messages:
    4,888
    Joined:
    Jul 31, 2004
    Great, how long before we have fake videos of politicians murdering people in smear campaigns during elections?
     
    Darunion, oldmanbal and Donald Bell like this.
  3. Donald Bell

    Donald Bell Limp Gawd

    Messages:
    160
    Joined:
    Apr 24, 2018
    I was thinking the same sort of thing when I was watching the video. This tech is a pandora's box. Between this, AI facial mapping and AI voice modulation, imagine where all this tech will be in 5 or 10 years.

    Scary stuff when you think about it.
     
  4. oldmanbal

    oldmanbal [H]ard|Gawd

    Messages:
    2,039
    Joined:
    Aug 27, 2010
    Drop the doom and gloom. This is a remarkable step for videogames. If a dev can go out and film an entire city, or say all of yellowstone park and then just crunch it I to a usable game environment this will leapfold game production on an order of magnitude. Instead of thousands of human hours focused on world building they could use that manpower on the other aspects of a game that make it fun and rewarding. Still have to see it in practice but it is a noteworthy accomplishment at the least.
     
  5. Ultima99

    Ultima99 [H]ardness Supreme

    Messages:
    4,888
    Joined:
    Jul 31, 2004
    Yeah I thought about that and it will be cool to see where games take this tech, but it's at our own peril to ignore the potential downsides.
     
  6. Ultima99

    Ultima99 [H]ardness Supreme

    Messages:
    4,888
    Joined:
    Jul 31, 2004
    You could have almost impossible to discredit fakes, and the next worry becomes when actual guilty people claim that real video is fake.
     
  7. Balzac

    Balzac Gawd

    Messages:
    989
    Joined:
    Jun 3, 2006
    I can't wait!!!
     
  8. TAP

    TAP Limp Gawd

    Messages:
    236
    Joined:
    Mar 29, 2016
    It's already happening. There are videos done of Obama to illustrate how easy it is to do this. They are calling them deep fakes.

    http://fortune.com/2018/09/11/deep-fakes-obama-video/
     
  9. oldmanbal

    oldmanbal [H]ard|Gawd

    Messages:
    2,039
    Joined:
    Aug 27, 2010
    There are also deep faps featuring the face of celebrities over pornstars in action
     
    travanx likes this.
  10. Jagger100

    Jagger100 [H]ardness Supreme

    Messages:
    7,452
    Joined:
    Oct 31, 2004
    You already can convince half the country a X did Y with no evidence or laughable evidence as seen in past few years. So it's a short trip.
     
    TAP likes this.
  11. Z3r0k3wl

    Z3r0k3wl [H]Lite

    Messages:
    124
    Joined:
    Feb 13, 2014
    Butcher of Bakersfield ;)
     
  12. lostinseganet

    lostinseganet [H]ard|Gawd

    Messages:
    1,133
    Joined:
    Oct 8, 2008
    So they are going after Euclideon Unlimited Detail's ideas?
    Also next gen hentai.
     
  13. katanaD

    katanaD [H]ard|Gawd

    Messages:
    1,987
    Joined:
    Nov 15, 2016

    so.. more in game advertising and loot boxes??

    :LOL:
     
    Darunion likes this.