NVIDIA RTX Video HDR on new 551.23 drivers!

III_Slyflyer_III

III_Slyflyer_III

[H]ard|Gawd
Joined
Sep 17, 2019
Messages
1,252
Been playing with it this morning, does wonders for SDR videos and "converting" them to HDR in real time! Arguably much more useful than VSR, but the combination of both now is great for streaming platforms where you may only get 1080P SDR content but want as close as you can get to 4K w/ HDR10.

1706111928590.png


https://www.nvidia.com/en-us/geforce/news/geforce-rtx-4070-ti-super-rtx-video-hdr-game-ready-driver/
 
Yeah, I know, was unsure though as this kind of counts as "tech news". Looking at this general area, I see posts about AMD Fluid Frames, RTX Supers, etc. So, I think it fits right in line, otherwise it looks like a ton of threads should be moved.
 
III_Slyflyer_III said:
Yeah, I know, was unsure though as this kind of counts as "tech news". Looking at this general area, I see posts about AMD Fluid Frames, RTX Supers, etc. So, I think it fits right in line, otherwise it looks like a ton of threads should be moved.
Click to expand...
all gpu related, which is what that section is for. If it were news about nvidia itself, sure. i dont see whats so hard about using the correct sections, or why people reeeeee when i point it out, its why kyle made them....
 
Odigo said:
It's tech news to me.
Click to expand...
you can use that excuse for basically anything "tech" related and with that train of thought , [H] should only have tech news, genmay and soapbox, and kyles been wasting his time with sub-forums all these years....
 
pendragon1 said:
all gpu related, which is what that section is for. If it were news about nvidia itself, sure. i dont see whats so hard about using the correct sections, or why people reeeeee when i point it out, its why kyle made them....
Click to expand...
Not mad, if it needs to be moved and someone has the ability, I'm all for it, please move it, if possible, I don't want to create any confusion or issues for people. :) I thought this was the correct area or I would have posted it elsewhere. It's kind of a tech feature, but yeah, GPU related, and I imagine AMD and Intel may follow suit with a software-based solution as some point as well.
 
III_Slyflyer_III said:
Been playing with it this morning, does wonders for SDR videos and "converting" them to HDR in real time! Arguably much more useful than VSR, but the combination of both now is great for streaming platforms where you may only get 1080P SDR content but want as close as you can get to 4K w/ HDR10.

View attachment 629818

https://www.nvidia.com/en-us/geforce/news/geforce-rtx-4070-ti-super-rtx-video-hdr-game-ready-driver/
Click to expand...

Now this looks interesting. But how? Video is fairly static, there are no details to dig out. The range of brightness is set at the mastering and skewing that up is, I guess, similar to using "Dynamic" mode in TV's which stretches the extremes to high heavens, probably just without the crushing of extreme details because we do have the bigger range of HDR in use.

AutoHDR and SpecialK and such work with more data because game engines do work in HDR internally and they can do more accurate guesstimation on what the game would look like if it had a HDR mode from the start. (Hell sometimes even better than half-assed HDR modes in some games) There is no such data on video files though. It is what it is.

I will give it a try though. I have been waiting for Last Samurai 4K HDR release for years but no luck. Maybe this will provide satisfactory results.

*edit* Damn, it does not work with MPC Video Renderer for media player classic, at least not yet.
 
Last edited:
MaZa said:
Now this looks interesting. But how? Video is fairly static, there are no details to dig out. The range of brightness is set at the mastering and skewing that up is, I guess, similar to using "Dynamic" mode in TV's which stretches the extremes to high heavens, probably just without the crushing of extreme details because we do have the bigger range of HDR in use.

AutoHDR and SpecialK and such work with more data because game engines do work in HDR internally and they can do more accurate guesstimation on what the game would look like if it had a HDR mode from the start. (Hell sometimes even better than half-assed HDR modes in some games) There is no such data on video files though. It is what it is.

I will give it a try though. I have been waiting for Last Samurai 4K HDR release for years but no luck. Maybe this will provide satisfactory results.

*edit* Damn, it does not work with MPC Video Renderer for media player classic, at least not yet.
Click to expand...
Pretty sure Nvidia has trained enough AI’s on HDR as to what it looks like that it’s able to approximate what it’s supposed to look like. So they just upscale, clean it up, and enhance and bam HDR’ish content.
 
Lakados said:
Pretty sure Nvidia has trained enough AI’s on HDR as to what it looks like that it’s able to approximate what it’s supposed to look like. So they just upscale, clean it up, and enhance and bam HDR’ish content.
Click to expand...
It wouldn't even need to know what HDR "looks" like, it just needs to be trained to look at the picture to identify how bright parts of it is and ramp up the dynamic range based on that. Microsoft already does this with Auto HDR in games.
 
I have been playing with this for over a week now, it works decently well. Obviously not nearly as good as true HDR content, but it does a decent enough job that in "most" cases, it looks better than the normal SDR content. In combination with the VSR, it really makes content pop that is not native 4K HDR.
 
I have been testing this feature with Youtube videos now (still waiting for MPC Video Renderer Support) to get a little taste of this. Before going any further, a little heads up. There is a slight bug in the latest drivers related to this feature. When you have HDR on but have this new HDR simulation OFF, you have elevated black levels. And I do not mean just washed out SDR video, that is normal because of the weird Piecewise Gamma that Windows uses for SDR content under HDR, but actually the browser is unable to show 0 level black. This is fixed by turning this HDR simulation on but it makes back and forth comparisons bit hard, especially if there are dark shadows involved.

Anyway, color me impressed. Sure, there is still no bright or dark details as expected, as there is none in SDR video and it will not make them up from nothing. Super bright (or dark) areas are still just crushed blobs of white or black. But overall image looks very realistic, very HDR:ish. It does not look like "Dynamic Mode" or anything like that. Skin tones are still natural etc. I was just watching a gopro video of a dude driving his motorcycle (and reviewing it) and when I turned this HDR thingy on it really did look like a HDR video. The image looked bright like he really was riding on daylight, which he obviously was. It looked natural. In Gamer Nexus review on the other hand, while it was good, it looked like he was under a spot light. Which he was but the HDR simulation slightly exaggerated it. But it still looks natural, skin color and all. I can't wait to test this out for movies!

*edit* On the other on different motorcycle video there is a black-yellow bike with a thin white stripe detail. This HDR effect exaggerates the white stripe, it makes it look like it is a reflective material that is glowing light back at you, which it is not. It is just a painted white line, not any brighter than the yellow next to it. So it is not perfect, far from it, but I am still exited about this feature.

*edit2* typo fixes
 
Last edited:
DPI said:
I'll have to research video player support for Nvidia's RTX HDR, I'm curious how it's hooking (D3D11/12, or something else).
Click to expand...
Right now, I'll just play a file through "Edge" as the player to get the HDR upscaling in real time if need be... Maybe VLC player will add it soon like it did with the VSR tech, but who knows.
 
I have to bump this thread because ho lee shit!!! Microsofts AutoHDR is kinda lackluster because of the limited compatibility and the fact you have to play around with gamma settings to not make everything look washed out by default. This (possibly) upcoming feature just works out of the box and you can this right now, you just have to do some driver modding because it has not been implemented fully yet but it already works just as well as it does for video.


View: https://youtu.be/BditFs3VR9c

Now, because this is just a post processing effect it cannot create any details that are not there and may make stuff that should not be bright be bright. And when bloom became a thing you may remember how overboard many games went with it, causing clipping and hiding details. RTX HDR cannot dig out any details thst are not there and may make those said blown out bloom effects look really dramatic and eyeball searing.

*Edit* there have been reports that this may actually make those blown out bright details worse. If true then it is probably the reason why it hasn't been fully implemented yet because this does not happen with RTX HDR Video.
 
Last edited:
MaZa said:
I have to bump this thread because ho lee shit!!! Microsofts AutoHDR is kinda lackluster because of the limited compatibility and the fact you have to play around with gamma settings to not make everything look washed out by default. This (possibly) upcoming feature just works out of the box and you can this right now, you just have to do some driver modding because it has not been implemented fully yet but it already works just as well as it does for video.


View: https://youtu.be/BditFs3VR9c

Now, because this is just a post processing effect it cannot create any details that are not there and may make stuff that should not be bright be bright. And when bloom became a thing you may remember how overboard many games went with it, causing clipping and hiding details. RTX HDR cannot dig out any details thst are not there and may make those said blown out bloom effects look really dramatic and eyeball searing.

*Edit* there have been reports that this may actually make those blown out bright details worse. If true then it is probably the reason why it hasn't been fully implemented yet because this does not happen with RTX HDR Video.
Click to expand...

I do hope we get official support for it in the future. From that video I can see multiple issues in addition to the blooming, though. It seems to give a shine on multiple surfaces as if we're back to the early 2000s when everybody was going overboard with specular effects.
 
Armenius said:
I do hope we get official support for it in the future. From that video I can see multiple issues in addition to the blooming, though. It seems to give a shine on multiple surfaces as if we're back to the early 2000s when everybody was going overboard with specular effects.
Click to expand...
I really didn't like that time period. Overly-shiny stuff looks really bad.
 
It will soon be official with no hacks. It is going to be a part of the new Geforce Experience and Control Panel overhaul which are already in beta.
 
I'm all about a control panel overhaul. The new Nvidia app is a step in the right direction, but it's still missing quite a few settings that seem to only be in the control panel.
 
Domingo said:
I'm all about a control panel overhaul. The new Nvidia app is a step in the right direction, but it's still missing quite a few settings that seem to only be in the control panel.
Click to expand...

Yeah thats why it is still beta. 😁 Personally though, I am not a fan of modern "clean" style of UI that have a habbit of hiding everything important to you somewhere out of the way and in the end are more confusing to power users. As oldschool as NV control panel is it is still super clear and you have access to everything you want without much need to search anything. Only downside is how slow it is, the code behind it hasn't been updated for years.
 
MaZa said:
Yeah thats why it is still beta. 😁 Personally though, I am not a fan of modern "clean" style of UI that have a habbit of hiding everything important to you somewhere out of the way and in the end are more confusing to power users. As oldschool as NV control panel is it is still super clear and you have access to everything you want without much need to search anything. Only downside is how slow it is, the code behind it hasn't been updated for years.
Click to expand...
Agreed. This beta is suffering from so many other modern UI conventions like too much white space. I'm glad that it is much faster now, but I can't say I'm a fan of the UI design.
 
My main desire for a new Nvidia Control Panel actually stems from helping from friends and my wife setup their systems with a Gsync monitor. I went through things step by step and it ended up being way more settings (hiding in some interesting places across 3 apps) to finally get things right. Especially when you take HDR into account, too.
 
The Future Enhancements section shows a bright future, I hope.

  • Future Enhancements
    • Moving forward, NVIDIA will be integrating the remaining features from the NVIDIA Control Panel, which will encompass Display and Video settings. Additionally, NVIDIA will be adding several attributes from GeForce Experience and RTX Experience, such as GPU overclocking and driver roll-back. During the NVIDIA app beta, GeForce Experience and the NVIDIA Control Panel will continue to be available.
    • Not all features will be making the transition, though. The primary goal with the NVIDIA app is to enhance the user experience, boost client performance, and pioneer RTX innovations. To achieve this, NVIDIA has made the decision to discontinue a few features that were underutilized, especially where good alternatives exist.
    • This discontinuation encompasses Broadcast to Twitch and YouTube, Share Images and Video to Facebook and YouTube, and Photo Mode 360 & Stereo captures. Streamlining features helps the NVIDIA app install in half the time, deliver a 50% more responsive UI, and occupy 17% less disk space than GeForce Experience.
    • On the beta roadmap, NVIDIA plans to offer AV1 support for Shadowplay, additional DLSS controls, extra overclocking options, and more
Click to expand...
 
I have been playing with the new MPC Video Renderer version with the RTX HDR support. My first test was with the Last Samurai but surprisingly, it does practically nothing. The movie does not have a lot of scenes with strong contrast and bright lights so I guess the upscaler does not know what to do with it and therefore does almost nothing, which is probably a good thing as it avoids mangling anything badly. Some stuff has a little bit increased saturation and brightness but unless you do side by side then you would not see the difference. Alas, I have to keep on waiting for a real 4k HDR transfer as far as this movie is concerned...
However on the other hand, Star Wars Despecialized Edition OG trilogy is completely different story. Those movies have plenty of high contrast scenes with bright lights and highlights and RTX HDR does spectacular job with them. Lights are bright, lightsabers look searingly hot, good stuff. 👍
 
You must log in or register to reply here.
Back
Top