• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

P3700 NVME -- Performance Issues

ToddW2

2[H]4U
Joined
Nov 8, 2004
Messages
4,017
System:
Motherboard: SuperMicro X10DRH-CT (Must be in UEFI bios to show NVME in bios, but still worked without it, comparing now to see if any difference in performance.)
CPUs: E5-2683 V3 (Both slots populated)
RAM: 4x16gb - 128gb DDR4 (on-list)
Host: ESXI 5.5 U2 w/Intel NVME Driver (Latest was 2014)
Pass-Through P3700/Controller to VM. (I also did as ESXI datastore and got slightly less performance, but still 50% less than 'advertised'.)
GuestOS: Win2012 R2 w/Intel 6/1/2015 NVME driver
NVME DRIVE: Intel P3700 800gb
NVME DRIVE Firmware: Updated via Intel Datacenter CLI Upgarde Firmware Command

Benchmark Software: CrystalDisk Mark (latest version -- supposed to support NVME drives with higher QDs-- made it faster but not advertised, or close.)

Intel P3700 Spec:
http://www.intel.com/content/dam/ww.../product-specifications/ssd-dc-p3700-spec.pdf


I notice this:


"Performance measured using IOMeter* with 128KB (131,072bytes) of transfer size with Queue Depth 128. Power mode set at 25W" (They even say it was win 2012 R2!!)

How does one change the power mode of a 2.5" NVME Intel drive? Is that something that can be done via CLI? If so why doesn't intel inform people the drive will NOT run at spec out of box?
 
I'm seeing 800MB/s Read/Write approx as my max no matter what I do.
pass through, data store, etc...
Old drivers, new drivers, didn't change much.
 
I'm seeing 800MB/s Read/Write approx as my max no matter what I do.
pass through, data store, etc...
Old drivers, new drivers, didn't change much.

You need the nvme cli management tool to change settings.

Crystal or AS-SSD won't show full speed of it. If you use the setup described in the pdf for iometer, then you will get very close performance to spec.

NVME really shines in high que-depth ramdon IO. I got 180K 4K random write IOPS and over 330K 4K random read IOPS while latency was only around 0.05ms.

Mine is 400GB PCI-E version.
 
Yes, the Intel Datacenter CLI is the "NVME CLI" I was referring too :)

That's how I updated firmware.

What's the command to run full power 25w?

I read somewhere make sure BIOS is set to FULL POWER and no PCIE power management is enabled too.

Which IOMeter settings did you use? I tried it but couldn't get anything near, so I know my settings were way off :)
 
With it stuck at PCI 3.0 1x and NOT working in certain other PCIE slots I'm going to venture to guess this may be a motherboard issue :( Waiting to here back from SM Techs if there's anything else I could try.

Tonight, if I can stay awake I plan to put it in another SM board and see how that one works.
 
With it stuck at PCI 3.0 1x and NOT working in certain other PCIE slots I'm going to venture to guess this may be a motherboard issue :( Waiting to here back from SM Techs if there's anything else I could try.

Tonight, if I can stay awake I plan to put it in another SM board and see how that one works.

Stuck at PCIe 3.0 1x ?

I see you have the X10DRH-CT .. which slots does it not work at all?

Curious how you were able to tell and if you have any other PCIe 3.0 devices
you could test with.

I was thinking of grabbing one to test out the performance too, but
my board is an SM X10SL7-F ..so wonder if I'd have a similar issue.
 
What MB do you have? Mine is X9SRL-F with no problem.

ESXi driver is not optimized well, speed is much lower than Windows.

Maybe there is hope, just to be clear you're using the AOC card with the "R" at the end or the one withOUT the "R" ? (One is cheap, one is $$)

My Motherboard:
SuperMicro X10DRH-CT

I could not get 1 of my x9 motherboard to detect it, even with latest BIOS.

Did you run ESXI on these x9 boards or Windows?

Did you pass 900Mb/s READ/WRITE in ESXI? If not what was your max, what about windows, what did you get? Please share more, I have a 2P 2011-v1/v2 board I want to run these in too... I actually have 2 controller cards and a couple drives.

Stuck at PCIe 3.0 1x ?

I see you have the X10DRH-CT .. which slots does it not work at all?

Curious how you were able to tell and if you have any other PCIe 3.0 devices
you could test with.

I was thinking of grabbing one to test out the performance too, but
my board is an SM X10SL7-F ..so wonder if I'd have a similar issue.

I started at 1 and worked my way through. I don't recall which exact ones it didn't detect/boot in but it's in Slot #7 now, and where it's detected/works just limited.

I do have other devices I can test the PCIE slots with, however SuperMIcro seemed convinced it was a BIOS issue.

Keep in mind the motherboard I have "IS" on the VERY SHORT list of THEIR OWN boards that is supported.

My ultimate goal is to run NVME with CentOS so I can use it for MySQL but that's even more of a hassle right now, seems a lot are having issues using and performance....
 
Back
Top