Nimble SAN Array Performance Report

[SGalbincea]

I just implemented a new Nimble setup at our primary client and wanted to share some results with you all.

Setup:
2x Nimble CS460 - 4x600GB SSD, 12x3TB SATA Each
2x Brocade VDX6740 in VCS Fabric Mode - 80Gb Trunk (These are AWESOME)
4x Dell VMware ESXi Hosts with 2x 10Gb iSCSI Links

Currently I have 4 VMs (4 vCPU, 8GB RAM each) running a SQL I/O process.

>24K IOPS under 100% 4K random write, sustained for the last hour. Can't wait to see the reads.

 

[NetJunkie]

What's your working set size?

 

[SGalbincea]

Parameters:

E:\file1.dat 2 0x0 30000
E:\file2.dat 2 0x0 30000

Batch file:

echo "**********"
echo "SQLIO random write test - increase run times"
echo "---- 4 min ---------"
time /t
sqlio -kW -frandom -t4 -s240 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 8 min ---------"
time /t
sqlio -kW -frandom -t4 -s480 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "----15 min ---------"
time /t
sqlio -kW -frandom -t4 -s900 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 30 min ---------"
time /t
sqlio -kW -frandom -t4 -s1800 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 60 min ---------"
time /t
sqlio -kW -frandom -t4 -s3600 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
time /t


echo "**********"
echo "SQLIO random read test - increase run times"
echo "---- 4 min ---------"
time /t
sqlio -kR -frandom -t4 -s240 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 8 min ---------"
time /t
sqlio -kR -frandom -t4 -s480 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 15 min ---------"
time /t
sqlio -kR -frandom -t4 -s900 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 30 min ---------"
time /t
sqlio -kR -frandom -t4 -s1800 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 60 min ---------"
time /t
sqlio -kR -frandom -t4 -s3600 -b8 -o8 -LS -BH -Fparam.txt
timeout /T 120
time /t


echo "**********"
echo "SQLIO sequential write test - increase run times"
echo "---- 4 min ---------"
time /t
sqlio -kW -fsequential -t4 -s240 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 8 min ---------"
time /t
sqlio -kW -fsequential -t4 -s480 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 15 min ---------"
time /t
sqlio -kW -fsequential -t4 -s900 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 30 min ---------"
time /t
sqlio -kW -fsequential -t4 -s1800 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 60 min ---------"
time /t
sqlio -kW -fsequential -t4 -s3600 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
time /t


echo "**********"
echo "SQLIO sequential read test - increase run times"
echo "---- 4 min ---------"
time /t
sqlio -kR -fsequential -t4 -s240 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 8 min ---------"
time /t
sqlio -kR -fsequential -t4 -s480 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 15 min ---------"
time /t
sqlio -kR -fsequential -t4 -s900 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 30 min ---------"
time /t
sqlio -kR -fsequential -t4 -s1800 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
echo "---- 60 min ---------"
time /t
sqlio -kR -fsequential -t4 -s3600 -b64 -o8 -LS -BH -Fparam.txt
timeout /T 120
time /t

 

[lopoetve]

We ran ours at a 400G working set, easily sustained 85K reads and around 60k writes on a 420. Great platform.

 

[SGalbincea]

We ran ours at a 400G working set, easily sustained 85K reads and around 60k writes on a 420. Great platform.

I assume those are sequential numbers, right? I have not gotten to the sequential portion of my script as of yet, will be interesting to see what it gets up to.

 

[SGalbincea]

200K IOPS at 8K Random read from 8 VM guests (2x50GB SQL I/O files)

 

[peanuthead]

Very nice! That looks sexy.

 

[lopoetve]

I assume those are sequential numbers, right? I have not gotten to the sequential portion of my script as of yet, will be interesting to see what it gets up to.

100% Random. I never run sequential - nothing in a virtual world is ~ever~ sequential

 

[SGalbincea]

100% Random. I never run sequential - nothing in a virtual world is ~ever~ sequential

Now that I see what this stack is capable of I retract my earlier question!

 

[Vader]

100% Random. I never run sequential - nothing in a virtual world is ~ever~ sequential

Not true! Copying ISO's and Templates to and from Datastore to another is sequential...lol....but yeah...99.999% is random...