The [H]ard Forum Storage Showoff Thread - Post your 10TB+ systems

Status
Not open for further replies.
I have built servers in the past but my new one is actually pretty neat.

More to come soon but it has 18 2TB WD20EARS drives.

This is the photo from when I first got the server before i started putting in drives but basically I picked up an R710 and a MD1200 off eBay. Reasoning: I needed something my dad could deal with when I'm not home.
Photo from when i first got the server:
er8QW.jpg
 
Last edited:
HP Microserver N36L
8GB RAM
5 x 3TB WD RED (300GB VMFS LUN, the rest is raw mapped to the fileserver)
HP P410 RAID Controller 256MB BBWC
Intel PCIe GbE NIC.
VMWare ESXi 5.0

Filserver is a virtual Ubuntu 12.04 Server LTS, about 11TB of usable storage space.
lL8jj.jpg

Overview, the barebone next to the Microserver is my HTPC which runs OpenElec/XBMC. The SQL database for XBMC runs on the Microserver.
zYqhT.jpg

Plugged the drive cage into the "wrong" port, that's why they are numbered from 5 up. The 5.25" cage is bay 1.
4cKKC.png

HP Agents for the RAID controller loaded for health monitoring.
JH3Ol.jpg

Not sure if this benchmark is to be trusted. Ran Atto from a virtual Windows 7 machine.
 
Last edited:
Just noticed this thread, figured I'd post my pc as it has 30TB (10 x 3TB). I use it for many purposes including gaming so it also has two 7970s. I found a way to fit 10 HDDs and 4 SSDs tidily and out of sight in the Corsair 800D, got the SSDs mounted securely with screws in the very bottom front.

UyxFs.jpg


5PFXX.jpg


O61pm.jpg


HBqjI.jpg
 
Case: Fractal Design Define Mini
PSU: OCZ Fatal1ty 1000W
Motherboard: ASUS Maximus V Gene
CPU: Intel i5-3570K ([email protected])
RAM: 16GB (4x4GB) Crucial Vengance
Controller: Onboard
Hard Drives:
OS
• 1x Crucial mSATA M4 256GB SSD
Storage
• 6x Seagate Barracuda 7200.14 ST3000DM001 7200RPM/64MB/3TB (Storage Spaces)
Operating System: Windows 8
Just finished building the backup server/gaming rig.
IMG_1990.jpg


It's in the process of being rsync'd over CIFS right now.
storage_space.png


Brings me up to a grand total of 36TB (12x3TB) raw, but it's spread across two systems.
 
Last edited:
This is my main linux desktop.

Antec Solo with a drive cage from an Antec P183 (tight fit with the raid card)
Asus M4A88T-I Deluxe w/ Phenom X4 820 and 8 GB ram
3ware 9650SE-16ML

40GB Intel X25V (OS)
4x 2TB WD Red (raid 5 storage)
4x 500GB WD Green (raid 5 backups)
2x 500GB Seagate Momentus XT (raid1 /home)
500GB refurb seagate (unused)

Before Drives:
cimg1287.jpg

With Drives:
p1000732_1.jpg

p1000733_1.jpg
 
Case: Fractal Design Define XL USB3.0 Titanium
PSU: Antec Quattro 1kW
Motherboard: Gigabyte GA-X79-UD3
CPU: Intel 8C/16T QA88 Xeon ES 1.6Ghz @ 2.0Ghz
RAM: 16GB (4x4GB) Kingston HyperX Blu
Controller: Onboard
Hard Drives:
OS
• Samsung 830 128GB
• WD Black 640GB
Storage
• 3x WD Green 2TB EARS
• 1x WD Green 2TB EARX
• 1x WD Green 2TB EARS
• 1x Seagate 2TB Barracuda LP
Operating System: Windows 7

Advertised: 12.7TB + various externals and 1TB in laptop.
Had the 2tb's running off a Rocketraid 2680 in raid 5, then was going to move to an LSI 8888ELP, but decided against it as I didn't NEED raid. So just individual hdds for now.

IMG_20121212_124807.jpg

IMG_20121212_124352.jpg


ouch, glad there is tons of room behind mobo
IMG_20121212_124043.jpg
 
40.94TB

Case : Lian Li 343-B
PSU : Corsair HX650W
CPU :AMD Athlon 64 2650e
Mobo : Asus M3A32-MVP Deluxe
RAM : 6gb Hynix DDR2 (2x2gb + 2x1gb)
Video : Diamond Stealth 2500 PCI
Controller Cards : Supermicro AOC-SASLP-MV8 x2
Hard Drives :
3TB Seagate ST3000DM001 x2, 3TB Western Digital WDC_WD30EZRS-00J99B0 x2
2TB Samsung HD203WI, 2TB Samsung HD204UI x2, 2TB Seagate ST2000DL003 x2, 2TB Hitachi HDS722020ALA330, 2TB Western Digital WD20EARS-00MVWB0 x2, 2TB Seagate ST32000542AS
1.5TB Samsung HD154UI x7
320gb Western Digital WD3200AAJS-60Z0A0
120gb Intel SSD SSDSC2CT120A3

Drive Cages: IcyDock MB455SPF-B x1, MB454SPF-B x4, MB876SK-B x1, MB-882SP-1S-2B (For the SSD)

Other : NZXT Sentry LX Fan Controller. The icydocks have been opened and I've put in Arctic F8's to cut down the noise... still noisy as hell however :)

Operating System : unRaid 5.0beta12

Used for Media storage, using Plex as a frontend for TV and movies and slimserver for music. And yes... if I did it again then I'd use a Norco :D

u_front.jpg


u_left.jpg


u_right.jpg
 
Well my home rack alone is gonna be >200 TB soon. I am getting another 24-30 TB of disks from work for free. The seagates have been soo unreliable for the company that they completely stopped using them and dont even RMA them anymore (we have hundreds of failed drives). I am going to take probably 30ish of the failed ones and RMA them myself and keep the replacements =).

Gonna use them in a SC846 box running open Solaris and just use it as backup storage along with my other zfs box (which is also now 24x1TB).

Since its just backup and ZFS the 1 TB drives should be acceptable.

So now for storage chassis I will have 3x SC846 (4u 24 disk) and 2x SC930 (3u 15 disk) machines all in my home rack. With the UPS's, two 2u and couple of 1u machines and my laser printer my rack is going to be super full =). Might have to remove that laser printer in the near future.
 
cdp181 said:
40.94TB

Case : Lian Li 343-B
PSU : Corsair HX650W
CPU :AMD Athlon 64 2650e
Mobo : Asus M3A32-MVP Deluxe
RAM : 6gb Hynix DDR2 (2x2gb + 2x1gb)
Video : Diamond Stealth 2500 PCI
Controller Cards : Supermicro AOC-SASLP-MV8 x2
Hard Drives :
3TB Seagate ST3000DM001 x2, 3TB Western Digital WDC_WD30EZRS-00J99B0 x2
2TB Samsung HD203WI, 2TB Samsung HD204UI x2, 2TB Seagate ST2000DL003 x2, 2TB Hitachi HDS722020ALA330, 2TB Western Digital WD20EARS-00MVWB0 x2, 2TB Seagate ST32000542AS
1.5TB Samsung HD154UI x7
320gb Western Digital WD3200AAJS-60Z0A0
120gb Intel SSD SSDSC2CT120A3

Drive Cages: IcyDock MB455SPF-B x1, MB454SPF-B x4, MB876SK-B x1, MB-882SP-1S-2B (For the SSD)

Other : NZXT Sentry LX Fan Controller. The icydocks have been opened and I've put in Arctic F8's to cut down the noise... still noisy as hell however :)

Operating System : unRaid 5.0beta12

Used for Media storage, using Plex as a frontend for TV and movies and slimserver for music. And yes... if I did it again then I'd use a Norco :D



Amazing, how come you have such variety of disk brand and sizes? no raid?

btw im counting 31.5TB, in your text.
Click to expand...
 
cdp181 said:
40.94TB

Case : Lian Li 343-B
PSU : Corsair HX650W
CPU :AMD Athlon 64 2650e
Mobo : Asus M3A32-MVP Deluxe
RAM : 6gb Hynix DDR2 (2x2gb + 2x1gb)
Video : Diamond Stealth 2500 PCI
Controller Cards : Supermicro AOC-SASLP-MV8 x2
Hard Drives :
3TB Seagate ST3000DM001 x2, 3TB Western Digital WDC_WD30EZRS-00J99B0 x2
2TB Samsung HD203WI, 2TB Samsung HD204UI x2, 2TB Seagate ST2000DL003 x2, 2TB Hitachi HDS722020ALA330, 2TB Western Digital WD20EARS-00MVWB0 x2, 2TB Seagate ST32000542AS
1.5TB Samsung HD154UI x7
320gb Western Digital WD3200AAJS-60Z0A0
120gb Intel SSD SSDSC2CT120A3

Drive Cages: IcyDock MB455SPF-B x1, MB454SPF-B x4, MB876SK-B x1, MB-882SP-1S-2B (For the SSD)

Other : NZXT Sentry LX Fan Controller. The icydocks have been opened and I've put in Arctic F8's to cut down the noise... still noisy as hell however :)

Operating System : unRaid 5.0beta12

Used for Media storage, using Plex as a frontend for TV and movies and slimserver for music. And yes... if I did it again then I'd use a Norco :D

http://www.smokingcures.com/images/u_front.jpg

http://www.smokingcures.com/images/u_left.jpg

http://www.smokingcures.com/images/u_right.jpg]
Click to expand...


Amazing, how come you have such variety of disk brand and sizes? no raid?

btw im counting 31.5TB, in your text.
 
Total advertised: 19.5TB
Total usable: 17.5TB

Chassis: Antec P150 + IcyDock 5in3
Motherboard: Gigabyte P55A-UD3
CPU: Intel i7 875K quad @ 4.0 GHz
RAM: 2 x 4GB DDR3-1333
HBA: Adaptec 5805
Hard Disks: 8 x 2 TB Hitachi 5K3000, 1 x 3TB Hitachi 5K3000, 1 x 500GB WD Black
PSU: Seasonic G 450
OS: Windows 8 x64

This is a very modest build compared to many on display here. It's primarily a file dump now, though the RAID will become a working drive when I upgrade to 10 GbE. There's a 4 x 2TB RAID-0 in my main system acting as a scratch drive at the moment. The RAID-5 benches around 600 MB/s with decent 4K numbers. Rebuild time for 1 dropped drive was 6 hours. Idle power draw is around 120W.

I like the drives and the HBA. The case is cramped. The PSU has coil whine issues and will be RMA'd. The motherboard will make things difficult later when I add the 10 GbE card. It only has two full-size PCIe slots and they're occupied by a passive ATI video card and the HBA. Cutting the video card (which was all of $10) to make it fit in a 1X slot is high on the agenda. Windows 8 has been fine (or was once I installed Start8). It's faster to initiate a RDP session.

Pictures forthcoming the next time I have the thing open.
 
Last edited:
Sysprofile.de - hpeter-storage

Mobo/CPU: ASUS E35M1-I, AMD E-350, 2x 1.60GHz
RAM: Corsair XMS3 2x 4GB 1333MHz CL9
LAN: 1x Gbit LAN (RTL8111E)
Gehäuse: Sharkoon Rebel 9 Economy / Dämmungsmatten Universalkit
120x120x25 Noiseblocker BlackSilent Fan 1000U/m 13dB(A)
Netzteil: BeQuiet Pure Power 300W ATX 2.3
HDD(system): Crucial v4 SSD 32GB, 2.5", SATA II
OS: Microsoft Server 2012 Standard

HBA: IBM ServeRAID M1015, PCIe 2.0 x8. 8x SATA 6Gb/s (IT Firmware)
2x 50 cm SAS-Kabel Mini-SFF-8087-Stecker 4-x SATA

HotSwap: 4x Cremax Icy Dock MB153SP-B, 3x SATA 6Gb/s
4x 80x80x25 Noiseblocker BlackSilent Fan X1 1300U/m 10dB(A)

HDDs: 2x Seagate Barracuda 7200.14 3000GB, SATA 6Gb/s (ST3000DM001)
2x Western Digital Caviar Green 3000GB, SATA 6Gb/s (WD30EZRX)
2x Western Digital Caviar Green 2000GB, SATA 3Gb/s (WD20EARS)
4x Samsung EcoGreen F2 1500GB, SATA 3Gb/s (HD154UI)
2x Western Digital Caviar Green 1000GB, SATA 3Gb/s (WD10EAVS)

Snapraid / Flexraid Pool, 18TB useable 6TB parity

p101022421uog.jpg
p1010250hquze.jpg


p101024113ub4.jpg
p1010252fou4b.jpg


p1010229x8u3i.jpg
p1010238bcupa.jpg
 
Last edited:
WoooT said:
Amazing, how come you have such variety of disk brand and sizes? no raid?

btw im counting 31.5TB, in your text.
Click to expand...

Thanks. Its using unraid so there is parity protection and a separate filesystem on each disk.

Maybe I wrote them down wrong, there are 4x3tb, 7x1.5tb, 9x2tb, 1x320gb, 1x120gb which is 40.94tb raw and 34.4tb actual including losing the parity drive, formatting and app SSD.
 
hpeter said:
Sysprofile.de - hpeter-storage

Mobo/CPU: ASUS E35M1-I, AMD E-350, 2x 1.60GHz
RAM: Corsair XMS3 2x 4GB 1333MHz CL9
LAN: 1x Gbit LAN (RTL8111E)
Gehäuse: Sharkoon Rebel 9 Economy / Cooltek Dämmungsmatten Universalkit
120x120x25 Noiseblocker BlackSilent Fan 1000U/m 13dB(A)
Netzteil: BeQuiet Pure Power 300W ATX 2.3
HDD(system): Crucial v4 SSD 32GB, 2.5", SATA II
OS Microsoft Server 2012 Standard

HBA: IBM ServeRAID M1015, PCIe 2.0 x8. 8x SATA 6Gb/s (IT Firmware)
2x 50 cm SAS-Kabel Mini-SFF-8087-Stecker 4-x SATA

HotSwap: 4x Cremax Icy Dock MB153SP-B, 3x SATA 6Gb/s
4x 80x80x25 Noiseblocker BlackSilent Fan X1 1300U/m 10dB(A)

HDDs: 2x Seagate Barracuda 7200.14 3000GB, SATA 6Gb/s (ST3000DM001)
2x Western Digital Caviar Green 3000GB, SATA 6Gb/s (WD30EZRX)
2x Western Digital Caviar Green 2000GB, SATA 3Gb/s (WD20EARS)
4x Samsung EcoGreen F2 1500GB, SATA 3Gb/s (HD154UI)
2x Western Digital Caviar Green 1000GB, SATA 3Gb/s (WD10EAVS)

Snapraid / Flexraid Pool, 18TB useable 6TB parity
Click to expand...

Nice system. Any idea on the power draw? Must be close to maxing out that 300w with all those drives.
 
cdp181 said:
Nice system. Any idea on the power draw? Must be close to maxing out that 300w with all those drives.
Click to expand...

No no
I have not measured, but the consumption will be under 150w.

12x HDDs ~8W -> 96W
Mobo, CPU, Fans ~ 30-40W
 
hpeter said:
No no
I have not measured, but the consumption will be under 150w.

12x HDDs ~8W -> 96W
Mobo, CPU, Fans ~ 30-40W
Click to expand...

Was thinking more of the 12v rail but I guess you will still be well under with such an efficient mobo and cpu.
 
upgrade to my home media server. thanks ebay!

proavio editbox with 8 - 2 tb wd green drives.

first time using flexraid. pretty cool so far. using 6 drives for data 2 for parity so i can lose 2 drives simultaneously and still recover.

398727_4177942131494_1940871655_n.jpg


564994_4177942091493_2022483045_n.jpg
 
Most of you have very impressive setups but may i ask what is it for since I see the pics I saw are mostly for the home?
 
silz said:
Most of you have very impressive setups but may i ask what is it for since I see the pics I saw are mostly for the home?
Click to expand...
This has been asked (and answered) before in this thread. Many of us use the 10TB+ systems to store media. Movies and TV series take up a LOT of space. I've got copies of all of my media on my file server, and I can access it from anywhere in the house. I can start a show in the living room, take a shower, and finish it in bed, all without pausing the show, or taking away the TV from my wife. I can also access my files from anywhere, allowing me to grab an older copy of homework off my server when I'm at school, listen to music when bored, or watch a video in between classes. I'm sitting at 13TB usable space right now (57% utilized), and this is how I've used it thus far:

Code: 
tim@solaris:/pool$ du -hs *
 118G   Applications
  42G   Documents
 321G   Downloads
 136G   Music
 170G   Other
  12G   Pictures
 5.4G   Sites
 6.7T   Video
 
silz said:
Most of you have very impressive setups but may i ask what is it for since I see the pics I saw are mostly for the home?
Click to expand...

My hard drives mostly fill up the empty space in a spare computer case. About 6TB of DVDs, less than 1000 DVDs. I watch less than 4 DVDs a week. About 6TB of TV shows I may never watch the first time.

Our business data which is on a different computer is only 50GB. All 20 years of data is only 50GB.

Misplaced priorities.
 
^^
multiple thousands of dvds/blurays just doesn't make sense anymore
file server gives you decent availability all over household and wherever you can reach it via internet
 
silz said:
Most of you have very impressive setups but may i ask what is it for since I see the pics I saw are mostly for the home?
Click to expand...

I use mine for hardcore porn, brazzers, naughty america etc.

EDIT: I'm being serial.
 
TeeJayHoward said:
This has been asked (and answered) before in this thread. Many of us use the 10TB+ systems to store media. Movies and TV series take up a LOT of space. I've got copies of all of my media on my file server, and I can access it from anywhere in the house. I can start a show in the living room, take a shower, and finish it in bed, all without pausing the show, or taking away the TV from my wife. I can also access my files from anywhere, allowing me to grab an older copy of homework off my server when I'm at school, listen to music when bored, or watch a video in between classes. I'm sitting at 13TB usable space right now (57% utilized).
Click to expand...

Are you saying you can pause in one room and resume in another? Please tell me how to do that :eek:

wirerogue said:
upgrade to my home media server. thanks ebay!

proavio editbox with 8 - 2 tb wd green drives.

first time using flexraid. pretty cool so far. using 6 drives for data 2 for parity so i can lose 2 drives simultaneously and still recover.
[images]
Click to expand...

What kind of read and write speeds do you get on the pool?
 
amarshonarbangla said:
Are you saying you can pause in one room and resume in another? Please tell me how to do that :eek:
Click to expand...
I used a laptop in both rooms, and just took it with me, but it's possible to just note where you're at in the episode, and slide the progress bar to that point on another system. If you're using a modern Apple device, you can stream from the (example) iPhone to the ATV, pause via the phone, and move to another room, then stream to a different ATV. Windows 8 offers a "Play To" feature which may have this ability as well - Not certain. Doubt many households have more than one XBox 360 in them, though!
 
TeeJayHoward said:
I used a laptop in both rooms, and just took it with me, but it's possible to just note where you're at in the episode, and slide the progress bar to that point on another system. If you're using a modern Apple device, you can stream from the (example) iPhone to the ATV, pause via the phone, and move to another room, then stream to a different ATV. Windows 8 offers a "Play To" feature which may have this ability as well - Not certain. Doubt many households have more than one XBox 360 in them, though!
Click to expand...

Oh that was the trick, just move the actual machine. I was thinking that you started playing in one device and resumed in another hehe.
 
If you're using XBMC with the centralized SQL database you can start a movie/episode on one device, stop it, move to another device and when you start the same movie/episode it will offer to start it from the same place you finish on the original device.

Obviously all XBMC devices need to be configured to use the same database.
 
GeorgeHR said:
Using BeyondTV you can stop watching on one device and start in the same place on another device.
Click to expand...

PANiCnz said:
If you're using XBMC with the centralized SQL database you can start a movie/episode on one device, stop it, move to another device and when you start the same movie/episode it will offer to start it from the same place you finish on the original device.

Obviously all XBMC devices need to be configured to use the same database.
Click to expand...

Both intriguing solutions. Will take it to the HTPC section for further discussion :)

Thank you both.
 
magnetik said:
Here's my current setup at the casa. This thread got me to actually inventory my stuff so thanks OP! hehe
I didn't count my numerous xbox's, laptops, media players, flash drives, spares, etc. Just my pc's and my external
storage. I can verify anything with a picture and my nick if anyone wants. I included Everest summaries to
each system so you can see they were dated all in the same day.
Click to expand...

Wow where can I find that hot-swap bay? It looks gorgeous.
 
Case: Fractal Design ARC midi
PSU: Corsair GS500
Motherboard: Asus F1A75-M
CPU: AMD A6 3500 2.1ghz triple core
RAM: Corsair 16gb kit 2x8gb 1333mhz
Controller: IBM M1015
Hard drive: 6x 3tb Seagate Barracuda 7200.14 ST3000DM001 ZFS Raidz2
SSD: 128gb samsung 830 l2arc cache
Hard drive: 2x 500gb Samsung 7200rpm ZFS mirror boot + torrent
Operating system: ZFSguru

Storage array capacity: 19tb raw 12.5tb usable
Network: HP N364T Quad gbit nic
UPS: MGE evolution 1550
Idle power usage 110watt

Very nice homeserver case the Fractal Design ARC Midi
326869_458169524219480_273134869_o.jpg


Cable management!
704197_458169510886148_1387655109_o.jpg


Lackrack with the server, data protector, switch, printer, 2tb network disk and ups
734973_471065782929854_919142889_n.jpg


I made this machine for the next 4 years for my storage of my fullhd video material from my sony cybershot. Also is store all of my files on it. Films music iso's programs etc.
I run my backups to the 2tb WD mybook live and a 4TB hitachi usb disk.

I made a video serie about the server!

Part1: http://www.youtube.com/watch?v=kBYMVUNrvDY
Hardware build!
Part2: http://www.youtube.com/watch?v=AyXasKDtcFQ
Lackrack Power Benchmarks NAS4Free
Part3: http://www.youtube.com/watch?v=1y9X5iddW98
12TB update, ZFSguru, indepth power, UPS, benchmarks

There is much more info in the video's and in the description of the video's! :D
 
hpeter said:
Sysprofile.de - hpeter-storage

Mobo/CPU: ASUS E35M1-I, AMD E-350, 2x 1.60GHz
RAM: Corsair XMS3 2x 4GB 1333MHz CL9
LAN: 1x Gbit LAN (RTL8111E)
Gehäuse: Sharkoon Rebel 9 Economy / Dämmungsmatten Universalkit
120x120x25 Noiseblocker BlackSilent Fan 1000U/m 13dB(A)
Netzteil: BeQuiet Pure Power 300W ATX 2.3
HDD(system): Crucial v4 SSD 32GB, 2.5", SATA II
OS: Microsoft Server 2012 Standard

HBA: IBM ServeRAID M1015, PCIe 2.0 x8. 8x SATA 6Gb/s (IT Firmware)
2x 50 cm SAS-Kabel Mini-SFF-8087-Stecker 4-x SATA

HotSwap: 4x Cremax Icy Dock MB153SP-B, 3x SATA 6Gb/s
4x 80x80x25 Noiseblocker BlackSilent Fan X1 1300U/m 10dB(A)

HDDs: 2x Seagate Barracuda 7200.14 3000GB, SATA 6Gb/s (ST3000DM001)
2x Western Digital Caviar Green 3000GB, SATA 6Gb/s (WD30EZRX)
2x Western Digital Caviar Green 2000GB, SATA 3Gb/s (WD20EARS)
4x Samsung EcoGreen F2 1500GB, SATA 3Gb/s (HD154UI)
2x Western Digital Caviar Green 1000GB, SATA 3Gb/s (WD10EAVS)

Snapraid / Flexraid Pool, 18TB useable 6TB parity

p101022421uog.jpg
p1010250hquze.jpg


p101024113ub4.jpg
p1010252fou4b.jpg


p1010229x8u3i.jpg
p1010238bcupa.jpg
Click to expand...


What kind of case is this and where can I get one?
 
Sharkoon Rebel 9 as written in the post. These are EOL and replaced by the T9-Series.
 
Status
Not open for further replies.
Back
Top