The [H]ard Forum Storage Showoff Thread - Post your 10TB+ systems

Status
Not open for further replies.
ST3F said:
I'm looking for these kind of performance with the same quantity of hard drive... I hope with 7200trs, it will be faster :)

  1. Have you "WDidle" these green drive before formatting ?
  2. No SSD for ZIL or L2ARC ?
  3. Do you have 1 gigabit or 10 GbE network ?

Cheers.

St3F
Click to expand...

1. I have not.
2. I dont have a zil or l2arc atm, but I have ordered 4 ssd disks to use as l2arc and a mirrored zil. I should get them this week.
3. I have 1gbit, and I can easily max that out unless I'm doing sync writes.

I use a seperate zfs share as an esxi datastore atm, and have problems with sync writes to it. I have disabled sync until I get the ssd disks for a zil.

I also plan to use the second onboard nic as a dedicated nic for the esxi datastore if I can get it working.
 
Did a benchmark with Bonnie++ after I added some ssd's. Not sure what all the numbers mean, but doesnt seem too bad.

iEI0n.png
 
apekatt said:
Did a benchmark with Bonnie++ after I added some ssd's. Not sure what all the numbers mean, but doesnt seem too bad.

iEI0n.png
Click to expand...
Indeed, for 5400Trs non aligned...

Compression / dedup / sanpshot : ON ?

You chose :
=> 2x VDev of 10x 3 TB RaidZ2

Could performance be better in :
=> 5x vDev of 4x 3 TB RaidZ2

??

Cheers.

St3F.
 
Last edited:
ST3F said:
Indeed, for 5400Trs non aligned...

Compression / dedup / sanpshot : ON ?

You chose :
=> 2x VDev of 10x 3 TB RaidZ2

Could performance be better in :
=> 5x vDev of 4x 3 TB RaidZ2

??

Cheers.

St3F.
Click to expand...

I dont use compression or dedup.
I take 1 snapshot a day on my media share, and every 6 hours on the esxi datastore.

You should get better write speeds with 5 vdevs, reads should be about the same. You'll loose alot more space to redundancy tho.
 
WHSv1 / AMD 4850e / ASUS M2N32-SLI Deluxe / 1x 2TB Hitachi / 13x 2TB WD Green / 1x 1.5TB Seagate / 4GB RAM

7 HHD on MB SATA2 Ports

4 HHD on Rosewill Silicon Image 4 port SATA2 PCI Express Host Controller Card

4 HHD in Rosewill RSV-S5 SATA 3G ... 3.5" HDD... 5-Bay Storage Enclosure



 
Not 10TB but thought some might interested in some performance benchmarks

Using a shiny new 12th Gen Dell PowerEdge 720xd at work. Before staging I was able to try out a variety of RAID configs.

Drives are 12x 600GB 10K SAS

RAID 0:
vo0mt.png


RAID 6:
gvWwJ.png


RAID 10:
dMzFe.png


RAID 60:
iYejt.png
 
zeroARMY said:
Not 10TB but thought some might interested in some performance benchmarks

Using a shiny new 12th Gen Dell PowerEdge 720xd at work. Before staging I was able to try out a variety of RAID configs.

Drives are 12x 600GB 10K SAS

RAID 0:
vo0mt.png


RAID 6:
gvWwJ.png


RAID 10:
dMzFe.png


RAID 60:
iYejt.png
Click to expand...

Under Windows ?
NTFS Formated ?

Raid6 seems good ; will you benchmark with ZFS RaidZ2 ?

Cheers.

St3F
 
zeroARMY said:
Not 10TB but thought some might interested in some performance benchmarks

Using a shiny new 12th Gen Dell PowerEdge 720xd at work. Before staging I was able to try out a variety of RAID configs.

Drives are 12x 600GB 10K SAS

RAID 0:
vo0mt.png


RAID 6:
gvWwJ.png


RAID 10:
dMzFe.png


RAID 60:
iYejt.png
Click to expand...

Good results for 12 spindles. Which raid card option is fitted? How much cache?
 
Hello Everyone,

Been a fan of the site for a while and always looked around as a guest... Well now I finished my server (well for now)... Future plans Raid 6 with 8x3TB

Details
Processor - Intel I7 3.20 1366
Motherboard - Rampage iii extreme
Memory - 12GB (6x2GB) CORSAIR
Power Supply - 800w
OS HD - OCZ Agility3 (SATA3) 120GB
Case - NORCO RPC-3116 3U
Raid Card - Intel RAID (RT3WB080)
Raid Expander - Intel RAID (RES2SV240)
OS - Windows 7

Total usable Storage 18.6TB

Raid 6 - 5.45TB (8x1TB) with hot spare
Raid 1 - 500GB (2x500GB)
Raid 1 - 2TB (2x2TB)
Raid 1 - 3TB (2x3TB)

Use of server - Media Server / some video editing / Backup. Streams to WDTV and 2/3 other PC's / Tables / XBOX360, and some internet streaming (Subsonic)

Now for the Pictures! (Sorry for the large images I couldn't find a way to resize them through the "IMG" tag :-(

Windows System
System.png


Windows Score
Score.png
***Stupid Video Card!!!! It was a cheap one I had laying around***

Most details on how its split...
Storage%20Divided.png


Total Capacity
Total%20Capacity.png


Front
front.jpg


Cables (So happy to have a big case)
cable1.jpg

cable2.jpg


Fans / Backplan
fans.jpg


New Expander Card
raid%20expander.jpg


Got questions ask!

Thanks
Tony
 
No photos just specifications.

Older motherboard with built in grsaphics.

Two 2TB WD greens and 1 128GB SS drive on the motherboard SATA ports.

Four 2TB WD greens on first PCIe controller.

One 2TB and three 1.5TB greens on second PCIe controller.

18.5TB total space. 5TB free.

Just videos (ripped DVDs and TV recordings).

Room for 1 more hard drive (2TB) before I need to upgrade from Windows XP and can handle larger hard drives in one partition..
 
kingtony911 said:
Hello Everyone,

Been a fan of the site for a while and always looked around as a guest... Well now I finished my server (well for now)... Future plans Raid 6 with 8x3TB

Details
Processor - Intel I7 3.20 1366
Motherboard - Rampage iii extreme
Memory - 12GB (6x2GB) CORSAIR
Power Supply - 800w
OS HD - OCZ Agility3 (SATA3) 120GB
Case - NORCO RPC-3116 3U
Raid Card - Intel RAID (RT3WB080)
Raid Expander - Intel RAID (RES2SV240)
OS - Windows 7

Total usable Storage 18.6TB

Raid 6 - 5.45TB (8x1TB) with hot spare
Raid 1 - 500GB (2x500GB)
Raid 1 - 2TB (2x2TB)
Raid 1 - 3TB (2x3TB)

Use of server - Media Server / some video editing / Backup. Streams to WDTV and 2/3 other PC's / Tables / XBOX360, and some internet streaming (Subsonic)

Now for the Pictures! (Sorry for the large images I couldn't find a way to resize them through the "IMG" tag :-(

Windows System
http://174.140.163.94/server/System.png[/IMG.]

Windows Score
[IMG]http://174.140.163.94/server/Score.png[/IMG.] ***Stupid Video Card!!!! It was a cheap one I had laying around***

Most details on how its split...
[IMG]http://174.140.163.94/server/Storage%20Divided.png[/IMG.]

Total Capacity
[IMG]http://174.140.163.94/server/Total%20Capacity.png[/IMG.]

Front
[IMG]http://174.140.163.94/server/front.jpg[/IMG.]

Cables (So happy to have a big case)
[IMG]http://174.140.163.94/server/cable1.jpg[/IMG.]
[IMG]http://174.140.163.94/server/cable2.jpg[/IMG.]

Fans / Backplan
[IMG]http://174.140.163.94/server/fans.jpg[/IMG.]

New Expander Card
[IMG]http://174.140.163.94/server/raid%20expander.jpg[/IMG.]

Got questions ask!

Thanks
Tony[/QUOTE]

Hey man, nice setup. Just a heads up, I recently moved my server (same exact chassis) and I did a little experiment with the case on and the case off. My temps were around 49c with the case off, and a few of the drive bays missing, but when I closed all the drive bays that didnt have drives, and put the lid on, my temps are now 40c.
It looks like your CPU fan might be too large for it to close, but I found a nice cooler master that will allow for closing if you want me to look it up. Anyway, great stuff... cheers!
Click to expand...
 
First built back in '08 shortly after OpenSolaris was released. Now it's running OpenIndiana 151_a5, with a 20TB zpool (2x5 drive raidz1 vdevs). Using builtin CIFS.

Mobo: ASUS M2N-LR (dual PCI-X FTW)
CPU: Phenom 9600 Quad
RAM: 8GB of something, I forget
PSU 1 (mobo/cpu): 650W
PSU 2 (drives): 350W
SATA Controllers 2x: SuperMicro AOC-SAT2-MV8
Drives: hodgepodge really, 5x HD204UIs, 4x WD20EARX, 1x ST32000542AS, 2x 250GB for root mirror

imag0250t.jpg


Shot was taken during upgrade from 1TB drives to 2TB drives. 22 drives spinning in the pic. Not bad for a budget fileserver IMHO.
 
zfs123 said:
First built back in '08 shortly after OpenSolaris was released. Now it's running OpenIndiana 151_a5, with a 20TB zpool (2x5 drive raidz1 vdevs). Using builtin CIFS.

Mobo: ASUS M2N-LR (dual PCI-X FTW)
CPU: Phenom 9600 Quad
RAM: 8GB of something, I forget
PSU 1 (mobo/cpu): 650W
PSU 2 (drives): 350W
SATA Controllers 2x: SuperMicro AOC-SAT2-MV8
Drives: hodgepodge really, 5x HD204UIs, 4x WD20EARX, 1x ST32000542AS, 2x 250GB for root mirror
Click to expand...
How can you manage Power up of the 2 PSU ?

Cheers.

St3F
 
zeroARMY said:
Not 10TB but thought some might interested in some performance benchmarks

Using a shiny new 12th Gen Dell PowerEdge 720xd at work. Before staging I was able to try out a variety of RAID configs.

Drives are 12x 600GB 10K SAS

RAID 0:
vo0mt.png


RAID 6:
gvWwJ.png


RAID 10:
dMzFe.png


RAID 60:
iYejt.png
Click to expand...

How much RAM?

Maybe try that test again with something larger than the 1000mb test default.
Something LARGEr than your RAM size... to avoid caching and crazy high readings;)

.
 
Intel Xeon 1260L
Intel S1200KP
Kingston 2x8GB 1333 Mhz ECC Memory
Silverstone ST50F 500W with short cable
Lian Li Q25

IO 151a5 w/ nappit
zraid2
10 x HD204UI 2 TB
IBM M1015 IT mode
2 x Crucial M4 64 GB

DSC_0781.jpg


DSC_0783.jpg

don't know if I can do any better cable management :/

thanks _Gea for his excellent work on nappit and fellow forum members for answering my noob question

bonnie.jpg


still tweaking out some stuff :D
 
Last edited:
balance101 said:
Intel Xeon 1260L
Intel S1200KP
Kingston 2x8GB 1333 Mhz ECC Memory
Silverstone ST50F 500W with short cable
Lian Li Q25

IO 151a5 w/ nappit
zraid2
10 x HD204UI 2 TB
IBM M1015 IT mode
2 x Crucial M4 64 GB

http://img.photobucket.com/albums/v11/Ba-Ka/DSC_0781.jpg[/IMG.]

[IMG]http://img.photobucket.com/albums/v11/Ba-Ka/DSC_0783.jpg[/IMG.]
don't know if I can do any better cable management :/

thanks _Gea for his excellent work on nappit and fellow forum members for answering my noob question

still tweaking out some stuff :D[/QUOTE]

Any chance you could put a temp gauge behind that thing and tell me how much heat its producing?
Click to expand...
 
The rear exhaust fan?

Will out door temp gauge work? I wish i had the instrument that can be attach to voltmemter
 
balance101 said:
The rear exhaust fan?

Will out door temp gauge work? I wish i had the instrument that can be attach to voltmemter
Click to expand...

I bought one of these USB thermo's they have on ebay for like $10 from china. It works pretty well. But yeah, by the exhaust fan.

*edit*
Actually, the psu fan.. that top fan blows out of sucks in?
 
about 31C~ from top and back exhaust fans

DSC_0781_temp.jpg


I need an better 140mm with higher static pressure the front HDD isn't getting enough cooling LOL

the bottom back is the coolest :/
 
balance101 said:
about 31C~ from top and back exhaust fans

http://img.photobucket.com/albums/v11/Ba-Ka/DSC_0781_temp.jpg[/IMG.]

I need an better 140mm with higher static pressure the front HDD isn't getting enough cooling LOL

the bottom back is the coolest :/[/QUOTE]

Ah ok, I was mainly trying to gauge my own heat issues. My 16TB (8x 2TB) is pumping out a solid 92F all day long... so it's like a little space heater, and my AC seems to run a lot. Wish I could find a self enclosed rack with cooling.
Click to expand...
 
Hi everyone.. I've been looking to build a home server for a while now, and was wondering if anyone could give me any suggestions.

I'm just looking to store my media files such as movies and music. I currently have a PC dedicated to ripping, gaming, etc, and I have another PC acting as a front-end for XBMC, so I'm looking for a very cost-effective solution..

My main goal is to assemble a home server that will back up everything on my main (ripping) PC, and act as a sort of a feeder to my (media) PC with XBMC on it.

Can I just assemble a barebones server with an i3 processor and ~6gb of RAM, along with an Intel NIC & a RAID card for raid 6? Will this be an effective solution for the uses I've described?

Also, what seems to be the easiest OS to use? Everything in my house is Windows 7, would it make sense to go with WHS, or are there better solutions (unRaid, FreeNAS, etc) that play well with Windows? I was thinking about just buying a Synology NAS, but really - I'm not sure if it's worth the price.

Sorry if this isn't really the place to be asking. Hopefully it's not taboo to ask for help in a "showoff" thread.
 
ricardforner said:
I love this case, which model is ?


Regards
Click to expand...

Lian Li Q25 have no front usb ports but have 5 hot swap, a great NAS case. Q18 has the usual itx PC case like 5.25, usb ports, audio ports and a bigger 140mm top fan exhaust. While the Q08 is very similar to Q25 but no hotswap and have 5.25 usb ports.

they look very similar :D

@dar124 not sure what your asking

between the 5th hotswap drive and the bottom two harddrive is a Crucial SSD

DSC_0783-1.jpg


Also the front bottom harddrive use a bracket to hold them together

DSC_0767.jpg


Some of the HD204UI is from the samsung M3/G3 external case so I use the four rubber as feet since I removed the bottom harddrive tray. But the feet being in the centre really isn't stabling the drive. As long as you don't put any thing heavy in the front end it won't tilt forward since its more heavy in the front of the drive where the magnetic disc are.
 
akg101 said:
Hi everyone.. I've been looking to build a home server for a while now, and was wondering if anyone could give me any suggestions.

I'm just looking to store my media files such as movies and music. I currently have a PC dedicated to ripping, gaming, etc, and I have another PC acting as a front-end for XBMC, so I'm looking for a very cost-effective solution..

My main goal is to assemble a home server that will back up everything on my main (ripping) PC, and act as a sort of a feeder to my (media) PC with XBMC on it.

Can I just assemble a barebones server with an i3 processor and ~6gb of RAM, along with an Intel NIC & a RAID card for raid 6? Will this be an effective solution for the uses I've described?

Also, what seems to be the easiest OS to use? Everything in my house is Windows 7, would it make sense to go with WHS, or are there better solutions (unRaid, FreeNAS, etc) that play well with Windows? I was thinking about just buying a Synology NAS, but really - I'm not sure if it's worth the price.

Sorry if this isn't really the place to be asking. Hopefully it's not taboo to ask for help in a "showoff" thread.
Click to expand...

The thing with prebuild NAS is once you exceed the 4 drive bay, its very expensive. I decided on ZFS raid given it was free license and you did not require an expensive hardware raid card. Also a great support community, you can't go wrong :D
 
balance101 said:
about 31C~ from top and back exhaust fans

*pic snip*

I need an better 140mm with higher static pressure the front HDD isn't getting enough cooling LOL

the bottom back is the coolest :/
Click to expand...

Ridiculous density!
 
16TB.

8x 2TB Hitachi 5k3000
IBM BR10i
HP NC380T PCI-E Dual Port Gigabit Ethernet
Foxconn A7DA-S 3.0 AM3 AMD 790GX
AMD Athlon II X2 250 Regor 3.0GHz Socket AM3 65W Dual-Core
G.SKILL Ripjaws X Series 8GB (2 x 4GB) 240-Pin DDR3 SDRAM DDR3 1333 (PC3 10666)
Rosewill HIVE Series HIVE-550 550W Continuous @40°C, 80 PLUS BRONZE Certified, Modular Design
NZXT H2 H2-001-WT White Steel / Plastic Classic Silent ATX Mid Tower Chassis

FreeNAS 8
RaidZ1
12hr Snapshots

Its silent, except for POST when hard drives spin up.

Genesis-Profile.png


Genesis-Side.png


OS Drive, Going to swap it to an SSD one of these days.
Genesis-Top.png
 
Last edited:
leeleatherwood said:
16TB.

8x 2TB Hitachi 5k3000
IBM BR10i
HP NC380T PCI-E Dual Port Gigabit Ethernet
Foxconn A7DA-S 3.0 AM3 AMD 790GX
AMD Athlon II X2 250 Regor 3.0GHz Socket AM3 65W Dual-Core
G.SKILL Ripjaws X Series 8GB (2 x 4GB) 240-Pin DDR3 SDRAM DDR3 1333 (PC3 10666)
Rosewill HIVE Series HIVE-550 550W Continuous @40°C, 80 PLUS BRONZE Certified, Modular Design
NZXT H2 H2-001-WT White Steel / Plastic Classic Silent ATX Mid Tower Chassis

FreeNAS 8
RaidZ1
12hr Snapshots
Click to expand...


That looks really awesome.. nice job.
 
elysium07_183.jpg




what it should like :

elysium_172.png



I'm not quite sure if I'm gonna use RAID1 or a backup software
neither the ZFS... since i'm running windows server 2008 R2
for the time being it's in software RAID5

here my result for the Software RAID5 (5x1To) :

raid5_116.png


I won't have to use it for small files
 
Here's my beast, just completed the other day. It's currently 16 drives including OS, expandable up to 26 currently. 27TB, 3TB for parity, 24TB of storage space! Running Disparity (see my link for a small build log and explanation of Disparity and it's features)

Thank you to EVERYONE who posts their system here, it allows people like me to see what options are out there, and what creative things people have done and incorporate or branch off of those ideas

6drivesinwithcustomsata.jpg


7sassatapluggedandlabel.jpg


8casefinished.jpg


9mobocloseup.jpg


http://hardforum.com/showthread.php?p=1039019670
 
Origin_Unknown said:
nice build!

is their any space between those drives at all?
Click to expand...

Thank you! :)

There is, obviously it's a little tighter than a typical 4-to-3 bay adapter but it isn't too bad. I have 5 WD 1 TB Black drives at the bottom that seem to be the only ones I'm concerned about currently, they hover around 38-42 degrees. The rest of them are WD Green drives (2 and 3 TB) and idle around 31-36 degrees. I may upgrade the fans in the future to something with a little more static pressure/airflow. For the time being I just set the drives to spindown as I RARELY use the stuff that is stored on the 1TB drives.

Not to say of course that 40 degrees is outside of the acceptable range, Google's hard drive data shows that hard drives being TOO cool (under 30 degrees) is just as bad if not worse than hard drives being TOO hot (50+), so for me it's all about the sweet spot in the middle.
 
Status
Not open for further replies.
Back
Top