The [H]ard Forum Storage Showoff Thread - Post your 10TB+ systems

[Mozar]

Amazing setup Melakion!!! So you are running all these disks off one raid card? I'm still trying to wrap my head around all these sas expanders.

 

[Deleted member 82943]

that's the beauty of SAS and expanders

 

[nry]

Amount of storage in the following system: 56TB (37TB usable)

Case: Xcase 424S
PSU: Corsair HX650
Motherboard: Asus P8B-WS
CPU: Xeon E3-1245
RAM: 4x Corsair 4GB DDR3
GPU: onboard
Controller Cards
- Areca 1882i-8 with BBU
- Chenbro SAS Expander CK23601
Optical Drives: N/A
Hard Drives:
- Boot Disk: OCZ Agility 60GB
- Array 1: 7x Hitachi 7K3000 3TB in RAID6
- Array 2: 8x Hitachi 5K3000 3TB in RAID6
- Array 3: 8x Mixed 1TB - RAID10
- Hot Spare: Hitachi 5K3000
Operating System: Ubuntu Server 12.04.2 LTS
NIC1: Intel X540-T2

Used for iSCSI of my ESXi VMs, iSCSI on my workstation, local backups, VPS backups and media storage.

 

[Deleted member 82943]

very unique case at least for me, very nice build.

 

[Master_shake_]

updated

 

[morgande]

Built a modest 15Tb ESXi AIO using OpenIndiana and Napp-It. Total usable space is just under 11Tb, running in a RaidZ configuration with 10% overflow protection. I also have a 1Tb local storage disk, and I plan on adding another 1Tb in a pool of mirrored Vdevs for VM storage.

Case: Antec P280
Motherboard: Gigabyte 990FX-UDA7
Processor: AMD-FX8150
Ram: G.SKILL Ripjaws X Series 32GB
Boot Disk: 8 Gb USB Micro key
Local Storage: Western Digital Black 1TB
SAN Storage: Western Digital Red 3Tb (3x - 15Tb raw capacity)
NIC: Dell/ Silicom PEG6I
RAID: IBM ServeRAID M1015
Power: CORSAIR HX Series HX750

Build video blog: http://www.youtube.com/watch?v=HyLuY7ZhHLY

 

[RangerXML]

I am not super proud of my current setup, but its coming along and does what I need it to.



WD 4TB Black (System)
WD 4TB MyBook (on my desk)

Mediasoninc 4-bay Enclosure:
2x 2TB WD Green
2x 1.5TB Samsung

Total of 15 TB Storage.

I still want to upgrade to 4x WD Greens in RAID 5, but for now this will do for my old system's storage drives.

 

[westrock2000]

I know it seems so crazy today, but in 20 years there will probably be 80TB drives for sale. And we will complain about how small they are. I remember back in late 80's a certain aerospace defense company have a 1TB server setup and it was impressive to say the least. Today that fits into a 2.5" drive that only needs the power of a USB port.

 

[DieTa]

@morgande Is it ECC memory? ZFS should have ECC.

 

[euskalzabe]

I know it seems so crazy today, but in 20 years there will probably be 80TB drives for sale. And we will complain about how small they are. I remember back in late 80's a certain aerospace defense company have a 1TB server setup and it was impressive to say the least. Today that fits into a 2.5" drive that only needs the power of a USB port.

Hehehehehe, you made me think that I now carry a 1TB slim drive in my POCKET. Crazy stuff. We'll probably also laugh at the fact that games like Hitman Absolution are nearly 20GB, which will probably be comparable to 20MB games of 15 years ago

 

[ComSpitfire]

192TB

64TB

3HE 19" Rack name ??
Seasonic passive 400W
Asrock Z77 Extreme6 Gen3
Intel I5 2500k
stock cooler
2x 4GB g.Skill Sniper DDR3 1866
Areca 1880ix 4GB DDR Memory
16 x Seagate Barracuda 5900 ST4000DM000
Ubuntu 12.4 LTS



I use this machine to backup my main computer and the HTPC.

32TB

3HE 19" Rack name ??
Corsair 650W
Asus F1A75V EVO
AMD 3870 Balck Edition Lioano
stock cooler
2x 4GB g.Skill RipJaws DDR3 1866
Areca 1680ix 4GB DDR Memory
16 x WD20EARX mod. with eidle tool ( no head parking )
Win 7 ultimate x64 bit


32TB

Lian LI PC71B .. ok the other drive cages are build out of three other PC71B
Hipro w700wc3 700w
Asus P5WDG2 PRO WS
Intel Q6600
Aquacomputer jet watercooler
4x 2GB Corsair PRO LED DDR2 800Mhz
Areca 1160 PCI X 1GB DDR Memory watercooled
16 x WD20EARS mod. with eidle tool ( no head parking )
Win 7 ultimate x64 bit

its looking like this when its powered on

 

[redsrule2500]

How do you guys with larger (10-20 TB+) storage solutions deal with backing up your data?

 

[Bigdady92]

I have a physical copy over another UNRaid system in another location and RSYNC weekly.

 

[war9200]

How do you guys with larger (10-20 TB+) storage solutions deal with backing up your data?

With secondary and tertiary 10-20TB+ systems that stay offline except for backup.

 

[redsrule2500]

^The expenses are just ridiculous, but that's what I figured. I'm already struggling to keep my 3 TB system backed up can't imagine an 8 TB system.

Although I am using 2x3TB Synology Hybrid RAID, so basically will be purchasing 4x3TB for 3 TB of storage, so my methods are very stupid.

 

[Matthew Kane]

I'd imagine that a full backup made on the first go for something like a 50TB+ server would be extremely time consuming, but incremental updates made later keeps things swiftly in control and only updated to the extra data/modification you have made. Anybody here also use any sort of cloud backup service to add that extra layer of security?

 

[saedrin]

Crashplan is working great for me. First year free with unlimited data, $4/month after that.

 

[greeneye]

Case: Xcase 424S

Absolutely love that case. My next investment for more actual storage space will be something like this.

Anyways I'd thought I'd post my current storage setup. In the last month has been a busy & new experience since I had to expand whilst learning how to use a new controller & everything else to go with it.

Had an Adaptec 3405 + Chenbro Expander but it gave so many issues with almost any drive combination I had with RAID0/5. I just figured it was old so I bought a LSI 9261-8i. Best decision so far!
After I bought the RAID Controller I needed more PCIe slots so I had an Asus P8Z77-V Deluxe mobo. The RAID controller would drop out in the second PCIe 16x slot when using it / file transfers were happening. The top PCIe 16x slot was fine but I needed that for my GPU.
I also realized I'm going to need more PCIe 8x / 16x slots for my HBA & SAS Expander.. so now I have an Asus Maximus V Extreme. Didn't really want it as its more a 'Gamer' board but it seems to be handling everything fine with all slots used.

Main Storage System

Case: Fractal XL (Modded)
PSU: Corsair AX1200
CPU: Intel i7 2700k (4Ghz)
Mobo: Asus Maximus V Extreme (Running BIOS: 0704 > Anything newer I get Error D5 / No Space For Legacy Option ROM - Caused by IBM M1115 )
RAM: 12Gb DDR3 HyperX (BIOS doesn't like more then 12Gb...)
GPU: EVGA GTX670 (Only used for LAN's)
RAID Controller: LSI 9261-8i (RAID5 / +BBU) > How I Improved my LSI 9261-8i Cooling
HBA Controller: IBM M1115 (Flashed to LSI 9211-8i)
PCIe Extras: Intel 1Gbe NIC (Ordering 4-Port 1Gbe NIC soon..)
5.25" Bay: Norco SS-500 (5-in-3)

1x 120GB SSD (Windows 7 Ultimate x64 Operating System)
10x 3TB's (7x WD Red / 2x Toshiba)
6x 2TB's (4x Seagate Barracuda / 1x Hitachi)

Total: 42.12Tb / Usuable: 35.34Tb (Minus: 1x 3Tb - Parity / 1x 120Gb SSD - OS Drive)

My backup tub has over 40Tb alone of each individual drive's backup/cloned data on it. One day it will all be connected & in sync 24/7 but for now I have to be practical. I also use a HP Microserver for personal backup's as well for quick shift for files & images when needed.

Ordered a new case with 12x 5.25" Bays & more internal space so I can cram more in the case. I shuffle a lot of drives in & out of the 5.25" bay and its becoming noticeable that I'm starting to wear it down. If I want more storage space I will have to look into a rack/server chassis with over 24+ HDD bays.

 

[RadXge]

Well, I might have the system with the smallest storage around here but it still meets the 10TB criteria..
Looking to add another 4TB in the near future...

Case: HAF-X
PSU: Corsair HX850W
CPU: Intel 3770K
Mobo: Asus Sabertooth Z77
RAM: GSKILL Ripjaws X 4x8GB DDR3-1866 CL10
GPU: EVGA GTX TITAN SLI
OS: Win 8 64-bit

Intel SSD 520 240GB
2 x Seagate 3TB
1 x Seagate 4TB
Total: 10.2TB

 

[netsonic]

My 14 TB Storage Server

HW: HP Proliant ML110 G5
CPU: Intel Q9300 CPU
RAM: 8 GB DDR2
RAID: Intel SRCSASRB 8 Port with BBU
HDD: 7x 2 TB Disks in Raid 5 (+ 1x 160 gb 2.5" drive for OS)
PSU: 350 W (Actual power consumed ~140 w)
OS: Windows Server 2012

Total Usable: 12.7 TB

 

[FelixJongleur]

I am not super proud of my current setup, but its coming along and does what I need it to.



WD 4TB Black (System)
WD 4TB MyBook (on my desk)

Mediasoninc 4-bay Enclosure:
2x 2TB WD Green
2x 1.5TB Samsung

Total of 15 TB Storage.

I still want to upgrade to 4x WD Greens in RAID 5, but for now this will do for my old system's storage drives.

Its a nice setup - but to post in here you should have 10TB+ in a SINGLE system

 

[FelixJongleur]

I'm with a few other people who have said maybe a separate thread should be created for larger storage servers - since we can get away with a 10TB+ 3 disk server now lol

 

[asgards]

indeed
back in the '04/05 we needed at least 8 drives to achieve 1tb ...
today 10 is done with 3 and almost 50 can be done with 12, with is basicly a desktop design

we truly need 50-100TB+ thread

 

[RangerXML]

Half of the reason I posted was as a joke, I could put 3x4TB drives in my Shuttle and I would have 10TB+. The mid level user, gaming and anime enthusiast almost needs 10TB of storage minimum to maintain the habit with new games coming in at 10GB+ and new encoding and larger file sizes for 720/1080p and now we are moving to 4k resolution. Just a humble observation.

FYI, all those drives use to be in my old case can't fit them all in my Shuttle.

 

[xagesz]

This is mine.

Current Stats:::::::::
Case: Lian-Li PC393B
PSU: Corsair 650TX
Motherboard: MSI Something. Just a cheap $50 board.
CPU: AMD Athlon X4 3.0ghz
RAM: 8gb Mushkin
GPU: Onboard
Controller Cards: RocketRaid 3530
Optical Drives: 5x Blu-Ray Samsung Drives
Hard Drives: 9 x 3TB Hitachi GST Deskstar 0S03230
Operating System: Windows 7



\

 

[fenixv]

So many blu ray drives

 

[Matthew Kane]

Probably burns movies and then sell em.

 

[tronmaster]

Its a nice setup - but to post in here you should have 10TB+ in a SINGLE system

Actually, he can post here. The very first post indicates a top 20 rankings which there are two versions 1) for total storage and 2) in a single chassis.

"Drive expanders and all external storage can count towards your total amount" is the quote.

 

[TheMantis]

Amount of storage in this system: 54TB

Case: Caselabs M8
PSU: Corsair AX850
Motherboard: Supermicro X8SIL
CPU: Intel i3-550
RAM: 2x2GB Micron 1333Mhz DDR3
Controller Cards: 2 x Supermicro AOC-SASLP-MV8, 1 x Supermicro AOC-SAS2LP-MV8
Hard Drives: 3 x Seagate ST4000DM000, 2 x Seagate ST3000DM001, 4 x Seagate T32000542AS, 2 x Seagate ST2000DM001, 1 x Seagate ST2000DL003, 9 x Western Digital WDC WD20EARS, 2 x Western Digital WDC WD20EARX, 2 x Western Digital WDC WD30EFRX
Operating system: unRAID

Primary use is storage of media. Secondary use is storage of backups for other computers.

 

[Deleted member 82943]

nice case, nice build. How do you like unRaid?

 

[TheMantis]

nice case, nice build. How do you like unRaid?

I'm pretty happy with it so far. Sure, it's not the fastest but it's more than capable of serving multiple Blu Ray streams. The operation of the OS has been without significant issue for the four years I've been using it.

 

[Kerbysj]

Hi guys been a long time lurker but never put up my system until now.

Specs-

Lian-Li p80b
4x x-case 5-into-3 hd caddys
Tyan S7025
2x E5530 Quad Xeons (2.4ghz)
12GB Ram
Supermirco MV8
Modified so now near silent

120gb OCZ Solid 3 (Win Server 2008 boot drive)
11x Samsung 2TB
2x Hitachi 2TB
1x Samsung 1TB
1x Hitachi 1TB

2x Seagate 3TB (Backup sit on shelf)

Each drive is currently configured as JBOD as seemed easier at the time to manage backup of my media files. (i.e lose a 10th of my data and i can see what ive lost and replace.)
Tempted to move to RAID but not sure which way to go? Any suggestions

Currently its in place as my fileserver/Game server. Want to change to VMWARE but dont want to risk fudging up my current config!
Current Capacity - 34TB - WOW Never worked that out before :s

Well thats the end of that server! I got 8x 4gb 1333 sticks from work installed them and on turning it back on something went bang! Makes no real sense. Same brand sticks (hynix) they were faster how i thought that would just be better for it..

Now when power is attached to the psu (tried on anouther psu same outcome) the fans connected to the mobo spin up however not at full whack.

I get no post beeps at all no monitor output either.

I have tried so far booting without any ram, changing the psu and discharging the board. Thats it so far as only happened last night and i was in no mood to strip it down to only find out its well and truely dead! Im going to look at this tonight, does anyone have any ideas where to go next? Or am i dead in the water till i get a new board?

I spoke to a retailer who deal with Supermicro boards and he recons since the RAM was HP branded (however still hynix just has a hp serial on it) that hes seen them to blow motherboards before. Ive never heard of this?

If someone can figure out what it could be which results me getting this working again i would hapily donate to a beer fund for you!

 

[Child of Wonder]

Rebuilt my home file server/iSCSI SAN.

Case: Thermaltake Armor
PSU: Corsair HX850
Motherboard: ASUS P8Z77-V LK
CPU: Intel i3-3225
RAM: 4x8GB GSkill 1333Mhz DDR3
Controller Cards: 1 x IBM BR10i
Network Cards: 1x Intel PRO/1000 VT Quad port
Hard Drives: 2x Intel 330 240GB SSD, 10x Seagate ST2000DM001 2TB 7200RPM
Operating system: Windows Server 2012 Standard

iSCSI storage presented to my home lab via Starwind iSCSI. RAM is used as read and write cache by Fancycache Beta.

The guts:


The lab (2 Hyper-V 2012 servers on the left, 3 VMware ESXi servers in the middle, file server on the right):

 

[Chipzilla]

Well - 20TB is not even close to the monster machines I have seen here but I managed to stay below 100W power consumption - an issue not to neglected nowadays ! ;-)

My setup:

-Chenbro SR107 Server Tower (4U rack convertible)
-Supermicro X7SPE-HF D525 Atom Server board w/2x 4 slot sata backplane
-4GB Kingston DDR3 1333
-LSI/3ware 9650SE 16ML raid Controller
-9x WD Green 2TB drives (WD20EARS, raid5) + 2x WD10JUCT 1TB 2.5 AV drives (raid1)
-Raidsonic IB-543SSK x3 sata backplane
-easy swap hdd tray from my Popcornhour C200 mediaplayer
-Raidsonic IB-2226StS 2x 2.5 sata hotswap Frame
-385W Seasonic 80+ power supply
-2x Delta SHE 120mm case fans (nice F16 sound when powering up the machine ;-)
-Scythe UltraKaze 120mm fan (actually not needed)
-APC Back UPS Pro 550GI grants 20 minutes uptime after

 

[Chipzilla]

Well - 20TB is not even close to the monster machines I have seen here but I managed to stay below 100W power consumption - an issue not to neglected nowadays ! ;-)

My setup:

-Chenbro SR107 Server Tower (4U rack convertible)
-Supermicro X7SPE-HF D525 Atom Server board w/2x 4 slot sata backplane
-4GB Kingston DDR3 1333
-LSI/3ware 9650SE 16ML raid Controller
-9x WD Green 2TB drives (WD20EARS, raid5) + 2x WD10JUCT 1TB 2.5 AV drives (raid1)
-Raidsonic IB-543SSK x3 sata backplane
-easy swap hdd tray from my Popcornhour C200 mediaplayer
-Raidsonic IB-2226StS 2x 2.5 sata hotswap Frame
-385W Seasonic 80+ power supply
-2x Delta SHE 120mm case fans (nice F16 sound when powering up the machine ;-)
-Scythe UltraKaze 120mm fan (actually not needed)
-APC Back UPS Pro 550GI grants 20 minutes uptime after

 

[Chipzilla]

upps - my Picture link does not work as it seems ! :-(

 

[Chipzilla]

upps - my Picture link does not work as it seems ! :-(

 

[devil22]

14TBs. 4x2TBs + 2x3TBs, in a storage spaces mirror configuration, formatted to ReFS with integrity streams (checksums files vs. just meta-data), running on Win 2012 Server Standard. Houses my collection of 170 Blu-ray remuxes (no downsampling).

And some stats on my movie collection, from a little powershell script I made:

Legend:
SD = Standard Definition (basically anything less than BR remux, so DVD rips, or down-converted BRs)
BR = Blu-Ray remuxes
Movs = total of SD and BR
SZ = Size, so BR SZ is Blu-Ray remuxes size
Other = non-media usage
<?> = Average Size, so <BR> is average of all Blu-Rays on drive.
BR Slots = total number of BR remuxes that will fit on drive at Average BR size.
BRs Avail = how many Blu-ray remuxes I can add to the drive at average BR Size
All sizes in GigaBytes, of course.

System: i7 3930K @ 4.0Ghz - Asus P9X79 WS - 4x4GBs Corsair 1600mhz - Corsair H80 + Gelid nanoflux fan - EVGA GTX 580 - Intel 520 120GB SSD - 7TBs + 7TBs HDD ReFS Storage Space Mirrors - Lite On 12x BD Writer - Corsair 750TX - CM Storm Trooper - Logitech G700 - 22" Dell UltraSharp 2209WA + 42" JVC HDTV 1080p - Windows 2012 Server Standard (Converted to Workstation.)

And now you can see why I didn't add a pic, my HDDs are buried in the case and you can see nothing any way, but in the interest of not making anyone else have a heart attack, I present the often requested pic:

 

[fXK]

This is thread is about posting picture of your big massive server hardware

WHO GIVES A SHIT IF YOUR HAVE UNDER 20TB OF SPACE or POST PICTURE OF YOUR SPACE

 

[Neb]

Mine is 14TBs. 4x2TBs + 2x3TBs, in a storage spaces mirror configuration, formatted to ReFS with integrity streams (checksums files vs. just meta-data), running on Win 2012 Server Standard. Houses my collection of 170 Blu-ray remuxes (no downsampling).

While those screenshots are nice, the OP explains what you should post:

If you want your name on the board, the following are required.

• Pictures of your actual systems (not a screenshot of disk management)
• Full system specs
• Post format must follow the example post
• Obviously you must have more storage than #20 on the list

Once you are ready to be considered for a spot on the board, make a post and send me a PM with the link.
Make sure you have the storage amounts in bold text and at the front of your post

Your post should include the following information. Try to keep it in the same order.

Amount of total storage (if posting multiple systems)
Amount of storage in the following system

Case
PSU
Motherboard
CPU
RAM
GPU (if discrete)
Controller Cards (if any)
Optical Drives
Hard Drives (include full model number)
Battery Backup Units (if any)
Operating System
(A short paragraph here describing what you use your storage for and how you handle backups and organizing would be nice.)