Final Fantasy XV’s Benchmark May Be Misleading

Megalith

Megalith

24-bit/48kHz
Staff member
Joined
Aug 20, 2006
Messages
13,000
According to Gamers Nexus, FFXV’s benchmark is “among the most misleading” they’ve encountered in recent history. Steve Burke elaborates on some of the stranger happenings, such as culling, LOD scaling, and selective object removal.

As it stands now, this benchmark is functionally useless as a means of determining component value. It is bereft of realism and plagued with, at best, optimization issues. We hope that this changes with the final game release; again, the benchmark is just 3.7GB, and the game will exceed 100GB. The point, though, is that the benchmark is likely unrepresentative of the final game, and therefore useless outside of synthetic testing and academic studies of performance.
 
not to mention you can glitch it and take control over the player in multiple places and thus drag out the length of the benchmark all while racking up points yep its a pretty pointless benchmark.
 
Gimpworks at it again, my vega 56 scored under what a vega 56 is supposed to get... why cant nvidia just play nice instead of being the biggest Dbag on the planet. all sides of the gfx wars should commit to using open standards if this happened we would be = to cinema levels of gfx
 
maxius said:
Gimpworks at it again, my vega 56 scored under what a vega 56 is supposed to get... why cant nvidia just play nice instead of being the biggest Dbag on the planet. all sides of the gfx wars should commit to using open standards if this happened we would be = to cinema levels of gfx
Click to expand...

That's not nvidia being douchebags, it's square enix rendering objects that impact performance when they aren't in the scene. The only way you can blame nvidia for this is if you assume they're the ones who convinced SE to horribly optimize a game(something I doubt SE needs assistance with). It sounds like you didn't even watch the video.
 
i used a custom shortcut so i could test it at my native resolution of 1440p and it ran really well for me on my 1080 ti, i scored 7289 with this setting, lowest fps i saw was 62, @ 4k setting i got down to 49 fps in some spots. even with the bad optimzation it still runs good at least

( "D:\Games\FINAL FANTASY XV BENCHMARK\ffxv.exe" --graphicsIni config\GraphicsConfig_BenchmarkHigh.ini -f --displayResolution 2560 1440 --renderingResolution 2560 1440 --locale=en )
 
Meh, these things were never really intended to be a benchmark in any scientific sense.

They've always been advertising. A way to build hype for the release. They've done these for major FFXIV releases as well - it's more about building up the hype, generating pretty screenshots, and enabling preorders than actually telling you how your machine is going to run.
 
Brian_B said:
Meh, these things were never really intended to be a benchmark in any scientific sense.

They've always been advertising. A way to build hype for the release. They've done these for major FFXIV releases as well - it's more about building up the hype, generating pretty screenshots, and enabling preorders than actually telling you how your machine is going to run.
Click to expand...

It is called The FF15 BENCHMARK it is to gauge your preference for an upcoming release.

im going to leave this here



same gimpworks bullshit that NVIDIA HAS always pulled...
 
maxius said:
It is called The FF15 BENCHMARK it is to gauge your preference for an upcoming release.

im going to leave this here



same gimpworks bullshit that NVIDIA HAS always pulled...
Click to expand...


This seems more like an error on SE's part instead of something intentional from Nvidia. The benchmark seems like it was something the dev team quickly slapped together, possibly from an older build, to try to give people an idea of performance. Missing some rendering exclusions is not impossible in that scenario. If Nvidia was as desperate to kill performance as you imply they would have made SE enable Hairworks on the four main characters and the Chocobos.
 
Brian_B said:
Meh, these things were never really intended to be a benchmark in any scientific sense.

They've always been advertising. A way to build hype for the release. They've done these for major FFXIV releases as well - it's more about building up the hype, generating pretty screenshots, and enabling preorders than actually telling you how your machine is going to run.
Click to expand...

The incoming disappointment for the people that fall for this trap.

I laugh
 
Brian_B said:
Meh, these things were never really intended to be a benchmark in any scientific sense.

They've always been advertising. A way to build hype for the release. They've done these for major FFXIV releases as well - it's more about building up the hype, generating pretty screenshots, and enabling preorders than actually telling you how your machine is going to run.
Click to expand...

Yeah. Canned benchmarks are never a great indicator of everything. I look at them more as a starting place to work from, but not a full indicator of actual performance. They can be fun to mess around with though.
 
Derangel said:
This seems more like an error on SE's part instead of something intentional from Nvidia. The benchmark seems like it was something the dev team quickly slapped together, possibly from an older build, to try to give people an idea of performance. Missing some rendering exclusions is not impossible in that scenario. If Nvidia was as desperate to kill performance as you imply they would have made SE enable Hairworks on the four main characters and the Chocobos.
Click to expand...

im just going to leave this here https://github.com/drdaxxy/ffxvBenchCustom for the uninformed gimpworks features are on by default in this benchmark
 
Brian_B said:
Meh, these things were never really intended to be a benchmark in any scientific sense.

They've always been advertising. A way to build hype for the release. They've done these for major FFXIV releases as well - it's more about building up the hype, generating pretty screenshots, and enabling preorders than actually telling you how your machine is going to run.
Click to expand...

'Member when they did this by releasing game demos?
 
I had a weird audio bug where 5.1 surround was shoved to the left channel with dB to the max.
 
maxius said:
im just going to leave this here https://github.com/drdaxxy/ffxvBenchCustom for the uninformed gimpworks features are on by default in this benchmark
Click to expand...

You are 1/3rd correct. Gameworks (can we please act like adults and not use retarded names) is only enabled for the High Quality preset and even then Shadow Libs and VXAO are turned off. For both Standard and Lite all Gameworks features are off.
 
They have a history of releasing benchmarks that don't equate to real world gameplay stemming back to the original ffxiv beta benchmarks. Can't really decide until the game launches and drivers are updated by both vendors.
 
Certainly fishy behavior. Gives more firepower to AMD users.

Th programmer in me thinks this is just bad/overseen coding but the conspiracy theorist in me thinks that there is a larger campaign to inflate GameWorks/Nvidia perfomance.
 
Sonicks said:
Certainly fishy behavior. Gives more firepower to AMD users.

Th programmer in me thinks this is just bad/overseen coding but the conspiracy theorist in me thinks that there is a larger campaign to inflate GameWorks/Nvidia perfomance.
Click to expand...

What makes this funny is just how meaningless this is in the context of the GPU market. AMD's GPUs aren't terrible, but they weren't great from a price/performance perspective at MSRP. Pricing being out of this world, you have no reason to buy one, even if you can.


[when mining crashes next and you can get Vega's for $200 a pop, yeah, jump on that!]
 
RiPpLeeFFecT said:
I had a weird audio bug where 5.1 surround was shoved to the left channel with dB to the max.
Click to expand...

Yeah I've tested the same thing, game completely looses it's shit if you have 5.1 audio, and if you bust it down to some kind of 16-bit play back the sound disappears entirely.
 
IdiotInCharge said:
What makes this funny is just how meaningless this is in the context of the GPU market. AMD's GPUs aren't terrible, but they weren't great from a price/performance perspective at MSRP. Pricing being out of this world, you have no reason to buy one, even if you can.
Click to expand...

Think that applies to all GPUs right now, not just AMD.
 
Yep same issue here. 5.1 audio results in no sound. Change sound setting to 44khz on 16 bit or 24bit and all I get is crackling garbage. Set the sound to stereo and it plays correctly. Either this benchmark is complete junk, or the port is. Not looking good for this title on pc.
 
wasteomind said:
Yep same issue here. 5.1 audio results in no sound. Change sound setting to 44khz on 16 bit or 24bit and all I get is crackling garbage. Set the sound to stereo and it plays correctly. Either this benchmark is complete junk, or the port is. Not looking good for this title on pc.
Click to expand...
Even though I already own on the PS4 Pro, I was considering buying on PC. At this point, I wouldn't touch it. Audio is important to me, and if not done right, its a huge turnoff for me.
 
Dregan73 said:
i used a custom shortcut so i could test it at my native resolution of 1440p and it ran really well for me on my 1080 ti, i scored 7289 with this setting, lowest fps i saw was 62, @ 4k setting i got down to 49 fps in some spots. even with the bad optimzation it still runs good at least

( "D:\Games\FINAL FANTASY XV BENCHMARK\ffxv.exe" --graphicsIni config\GraphicsConfig_BenchmarkHigh.ini -f --displayResolution 2560 1440 --renderingResolution 2560 1440 --locale=en )
Click to expand...

Did this as well. NOTE: Screen will still say 1920x1080. Got around 7400-7600 with 1080ti + 8700k.
 
You must log in or register to reply here.
Back
Top