The [H]ard Forum Storage Showoff Thread - Post your 10TB+ systems

Status
Not open for further replies.
GeorgeHR said:
I have learned to not post anything that might be traced back to me.

But it is nothing fancy. A piece of plywood 5"x11" with 2 rows of holes. Each with 8 holes spaced 1-1/4" apart I think the holes are a little bit sloppy for 8-32 screws. (the screws go in the sides of the drives)
Click to expand...


Picture or it didn't happen
 
GeorgeHR said:
I have learned to not post anything that might be traced back to me.

But it is nothing fancy. A piece of plywood 5"x11" with 2 rows of holes. Each with 8 holes spaced 1-1/4" apart I think the holes are a little bit sloppy for 8-32 screws. (the screws go in the sides of the drives)
Click to expand...

sounds like you need a tinfoil hat :D:D:D:D:D:D:D
 
Rpkole said:
my baby 22.5TB worth of disk in raid 6 for 19.5TB of space
Click to expand...

Have you considered doing a RAID 50 or 60? RAID 5 down - 1 disk per hot-swap enclosure - then stripe across? And use the fully internal drives as hot spares. I've seen this done with enclosures of 10+ disks and it protects you against not only against a drive failing but also a whole enclosure failing. Obviously you lose 1/3 of your drive space so 12x 2 TB drives in RAID 50 only gives you 16 TB of fault-tolerant space rather than the 20 TB you'd get with RAID 6.
 
uhm... sure? ;)
A RAID50 is a RAID0 using multiple RAID5s - so this will not give you the redundancy for a whole enclosure failing. (That would be RAID05, so a RAID5 consisting of multiple RAID0s, don't know if that's supported by any RAID card)

imho the RAID6 is a better choice over a 50.
In a RAID6 2 random drives could fail - in a RAID50 one drive per leg (R5 array) can fail without losing data. If you create this RAID50 in 4x4 (4 R5-legs of 4 disks each) you have 4 disks of redundancy. If the 'right' 4 fail everything's fine - but as 2 disks in one leg fail you got big trouble...

Clearly the RAID60 would improve the security over a RAID6, but at what cost?
 
You RAID 5 down across the enclosures, then stripe across. Each vertical set is its own RAID 5, so it's RAID 5+0 = 50. You're therefore protected (a) against any one drive failing in any drive set, and (b) you're also protected against a whole enclosure failing (taking out four drives).
 
While discussing raidlevels and 'fancy' ways of trying to avoid data loss with how you set it up is fun, you should never forget that RAID is not backup.
 
@widla: Ack!
My whole array is the backup for other PCs - so the whole array would not be a fatal loss. But: If there's the choice betweeen replacing a drive or setting up a new array and copying lots of stuff...
 
replaced a iStarUSA JBOD 15HD case:

4PtUUl.jpg


with a RPC-4220 (during setup):

Qj7i5l.jpg


In the rack:

GdoXSl.jpg
 
Haven't posted on this forum in a long time, but since I'm here might as well add my NAS to this thread.
Not very impressive compared to a lot of the systems on here (15TB), but it's nice and compact. Built last summer for fun.

Components:
LIAN LI PC-Q08B Black Aluminum Mini-ITX Tower
SUPERMICRO MBD-X7SPA-H Mini ITX Intel Atom D510
Kingston 4GB (2 x 2GB) 200-Pin DDR2 SO-DIMM DDR2 800
OCZ ModXStream Pro 500W Modular
Patriot Xporter Mini 8GB Flash Drive
HITACHI Deskstar 0S03230 3TB (x5) +1 spare

Freenas 0.7.2 (revision 6694)
RAIDZ1 (ZFS with 1 parity drive) 13.6 TB (10.7 usable).

download1rh.jpg

download2g.jpg

imag0112tn.jpg

imag0114vv.jpg

freenas.jpg

drive2b.jpg
 
Last edited:
Sorry if this is a little offtopic, but I just received a 3 TB Hitachi HDD (HDS723030ALA640) I ordered last week.

It says "JUL-2011" on the front, which is the production date I suppose.
Should I be worried that the HDD is that "old"?
 
xfataa said:
Sorry if this is a little offtopic, but I just received a 3 TB Hitachi HDD (HDS723030ALA640) I ordered last week.

It says "JUL-2011" on the front, which is the production date I suppose.
Should I be worried that the HDD is that "old"?
Click to expand...

As long as you can wash off the flood stains it should be good. :)

No its fine. It just happened to sit on a shelf for a bit. Probably should keep your original receipt in case you need it to claim the warranty in the future since most drive warranties are from manufacturing date unless you can document the in-service date to get an exception.
 
xfataa said:
Sorry if this is a little offtopic, but I just received a 3 TB Hitachi HDD (HDS723030ALA640) I ordered last week.

It says "JUL-2011" on the front, which is the production date I suppose.
Should I be worried that the HDD is that "old"?
Click to expand...

....that "old"? Those drives have a 5 year warranty so it is not that "old". If you fell uncomfortable with it do a RMA and hope they send you a newer one.
 
Here's my NAS, its built in a Fractal Design Array R2 with Fractal's 300W SFX power supply.

This is a setup with FreeNAS 8.0.3 right now, six 2TB drives, three of then WD Green and three Seagate Barracuda, within the summer I'll change the WD drives, for Seagates.
This is running RAID-Z2, so there's 7,8TB usable space, out of total 12TB, two drives are spare. FreeNAS is installed at a 4GB USB-pen, that's inside the case.

Components:
  • MB: Zotac H67ITX-C-E
  • CPU: Intel Core i3 2100T
  • RAM: Kingston ValueRAM DDR3-PC10600 8GB
  • HDD 1-3: Seagate Barracuda 2TB (ST2000DM001)
  • HDD 3-6: Western Digital Caviar Green (2TB WD20EARS)
  • Ethernet: Intel Pro/1000CT (EXPI9301CT)
  • OS: FreeNAS 8.0.3 (X64)


Front end of the case.

Rear end of the case.

Rear end, with the top lid removed.

Removed the power supply, for a view down to the motherboard, and rear end of the harddrives.
 
Last edited:
I use the same kind of cable as monster stealth mentions over here, but It's bought from Performance PC's.
 
sekkey said:
replaced a iStarUSA JBOD 15HD case:

http://i.imgur.com/4PtUUl.jpg

with a RPC-4220 (during setup):

[IMG]http://i.imgur.com/Qj7i5l.jpg

In the rack:

[IMG]http://i.imgur.com/GdoXSl.jpg][/QUOTE]

I worked for an integrated systems company that does Control4. Good products!
Click to expand...
 
dashpuppy said:
PITA to setup tho, and moving from firmware to different version's = MAJOR PITA
Click to expand...

Going from 1.8 to 2.0 was a pain but the incremental upgrades aren't so bad. Also, control4 isn't a DIY system. Are you a c4 dealer? If so, thats awesome. If not, its almost impossible to install it yourself without access to the dealer drivers.
 
Just updated the core of my NAS; impressive how well Centos 6 dealed with the complete hardware change.

Now running:
Iwill DPK66S 5000X Dual Xeon
Intel Xeon L5335 (2.0Ghz QC 50W TDP)
4GB ECC DDR2-667 FBDimm
Adaptec 52445 SAS Raid
10 WD WD20EADS 2TB in Raid6
10 Hitachi 7K3000 2TB in Raid6
Norco RPC-4220
6 80CM PWM AKA Fans
Thermaltake LG771 HSF
Centos 6

Nice to have the much more powerful CPU, additional PCI-E slots and Intel NICs that do Jumbo Frames.
 
Last edited:
sekkey said:
Going from 1.8 to 2.0 was a pain but the incremental upgrades aren't so bad. Also, control4 isn't a DIY system. Are you a c4 dealer? If so, thats awesome. If not, its almost impossible to install it yourself without access to the dealer drivers.
Click to expand...

used to set them up and setup the networking for the dealer in town.
 
Hi Storage Freaks,

Here are my two sandy bitch storage servers for homeuse.

et voilá here they are

SandyBitch Server #1 = 24TB (12*2TB) @ Sharkoon Rebel9 Alu: ...used for multimedia strorage

formatted storage @ Raid5 i have 20TB

System-Specs:
Case: Sharkoon Rebel9 Aluminium with MeshFront
PowerSupply: be quiet! Straight Power E8 400W ATX 2.3, (E8-400W/BN153)
Motherboard: Gigabyte GA-Z68X-UD3H-B3, Z68
CPU: Intel Core i3-2100, 2x 3.1GHz, HD2000
RAM: 16GB (4x4GB) GeIL Value Plus DDR3-1333, (GVP38GB1333C9DC)
RAID - Controller: Areca ARC-1231ML
HDD - System: Crucial M4 128GB
HDD - VirtuakMachines&Download: Hitachi Travelstar HTE723216L9A360 24x7
HDD - Storage: 12x Hitachi Deskstar 5K3000 2000GB 24x7 (HDS5C3020ALA632) @ 3x 4in3 HDD-Moduls Cooler Master
OS: WIN7 x64

CPU - Cooler: Scythe Ninja Mini + Retention
Case - Fans: 7x Coolink SWiF2-1201; 2x Coolink SWiF2-92P; 1x Noiseblocker NB-BlackSilentFan XM2 @Areca
FanControl: NesteQ MaxZero

PowerConsumption & Temps:
WIN7: IDLE: 98-105W : LOAD: 130-136W (Prime95+FurMark)
CPU: IDLE: 30°C : LOAD: 45°C (Prime95)
HDD: 29-35°C

and of course some pictures:



SandyBitch Server #2 = 16TB (8*2TB) @ Fractal Design Array R2:

System-Specs:...used for multimedia, build for my parents
Case: Fractal Design Array R2 300W SFX
Power -Supply: Fractal 300W SFX (i guess from FSP Fortron)
Motherboard: ASUS P8H67-I Rev 3.0, H67 (B3), (90-MIBEZ0-G0EAY0DZ)
CPU: Intel Core i3-2100T, 2x 2.50GHz, HD2000
RAM: 4GB (2x2GB) exceleram Black Shark DDR3-1333, (E30129A)
RAID - Controller: LSI AMCC 3Ware 9650SE-8LPML
HDD - System: Super Talent Ultradrive FTM32GX25H
HDD - Storage: 8x Hitachi Deskstar 5K3000 2000GB (HDS5C3020ALA632) ... two of them installed via sharkoon quick-stands
OS: WIN7 x64

CPU - Cooler: Scythe Shuriken B2
Case - Fans: 2x Noiseblocker NB-BlackSilentFan XR2 back; 1x Noiseblocker NB-BlackSilentFan XM1 @ 3Ware; 1x Noctua NF-P14 FLX front

PowerConsumption & Temps:
WIN7: IDLE: 79-81W : LOAD: 109W (mit Prime95)
CPU: IDLE: 34°C : LOAD: 47°C (mit Prime95)
HDD: 33-35°C


 
Last edited:
@hotzen: that idle power consumption is fine. Board+CPU itself will use ~40W. 8 hard drives. Hard drive consumes 4.4W per drive in idle, that is 8x4.4=35,2W/0.8 (80% PSU efficiency)=44W for the hard drives from the wall.

40+44W = 84W, which is roughly the same value he sees, and he even does have a RAID controller in his computer.

Hard drives are nasty power hungry things when you got lots of them.
 
faugusztin said:
[...]...40+44W = 84W, which is roughly the same value he sees, and he even does have a RAID controller in his computer.

Hard drives are nasty power hungry things when you got lots of them.
Click to expand...

you´re absolutly right. I set the spindown timer to 60min at both systems. For saving power a good opportunity would be to switch over to an "unRAID"-System / OS (aka lime tech.).
 
28.168 TB

Case: Fractal Design Define XL
Mobo: ASUS M4A89GTD Pro
CPU+HS: AMD Phenom II X6 1090T + Scythe Mugen 2 Rev.B
RAM: 16GB (4x4GB) Kingston KVR1333 ECC Memory
PSU: Enermax MODU82+ II 625W
NIC: Intel Gigabit CT Desktop Adapter, PCIe x1
Controller: Intel SASUC8I, PCIe x8, 8x SAS/SATA with LSI non-RAID firmware
HDD: 14x Western Digital Caviar Green 2000GB (WD20EARS)
1x 40GB OCZ-VERTEX2 (OS drive)
1x 128GB Super Talent STT_FTM28GX25H (cache drive, a RMA drive)
OS: Oracle Solaris 11
Fans: case fans replaced with be quiet! Silent Wings USC, 2x 120mm + 2x 140mm on the cases fancontroller

This is my little NAS for backups and mainly for my anime pile.
I am using ZFS raidz2 with encryption which gives me about 20TB via SMB share, currently 75% used. It delivers 80-90MB/s speeds, more than enough for most needs and pretty close to gigabit topspeed. The system might not be silent BUT it is very quiet.

nas-loaded.jpg
 
I built the system about a year ago - since then the HDD prices went up due to the flooding in Taiwan.

All parts at current prices (incl. small things like the 5.25" HDD adapters or the SAS x4 (SFF-8087) to 4x SATA cables) would bring the total to somewhere around 3000€ / US $4000, about half of that for HDDs alone.

My NAS is slowly running out of space and I don't have a backup solution so I am slowly starting to look into a second, larger NAS. It would be the easiest way to copy the setup and just use 3TB HDDs. But I kinda want to be able to use more HDDs in one case, which would require a 19" solution BUT it has to be quiet like my current setup.
 
DocSilly said:
I built the system about a year ago - since then the HDD prices went up due to the flooding in Taiwan.

All parts at current prices (incl. small things like the 5.25" HDD adapters or the SAS x4 (SFF-8087) to 4x SATA cables) would bring the total to somewhere around 3000€ / US $4000, about half of that for HDDs alone.

My NAS is slowly running out of space and I don't have a backup solution so I am slowly starting to look into a second, larger NAS. It would be the easiest way to copy the setup and just use 3TB HDDs. But I kinda want to be able to use more HDDs in one case, which would require a 19" solution BUT it has to be quiet like my current setup.
Click to expand...

Buy Norco RPC 4224 and make it quiet.. takes 24 hot swaps! :)
 
shurcooL said:
It's funny how I'm able to get by with my 250 GB NAS.
Click to expand...

When I first came across this thread I was like, oh yeah, I'm so going to need one of these types of systems and really started planning... and building...

I got a 4020, 3 1TB HDDs to start with and was going to expand as needed...

I moved everything I had to the server, and so it began...


I don't even have 1TB of stuff to save... from 2002 till now, I haven't lost any files.

I don't really regret building the over kill server... but.. I totally could of saved some money lol.

I honestly would have gotten the smaller versions like the 4 or 8 HDD versions, but the price difference and needed a different type of PSU I didn't care for it.
 
I have done hotswapping both in my file server which has a single rail PSU & in my main rig which has a dual rail PSU.. every time I unplug & plug in a HDD, other HDDs momentarily lose power - enough for RAID arrays to degrade!

I may in the future get a Norco 4224... how does one hotswap HDDs without other HDDs losing power? :confused:

TIA
 
The NORCO is not available here in Germany. There are similar 4U-24x hotswap cases available, like the Supermicro 846TQ-R900B, starting at 1000€ / US$ 1300. That is :eek: compared to $400 for the NORCO RPC-4224.

The second issue would be NOISE, I certainly won't run one of those with the original fans - the Supermicro comes with 5x 5000RPM screamers, ouch. It looks like one needs to put some real work into getting one of those cool and quiet.

How quiet it needs to be? Very, my current NAS is as quiet/quieter than my external 1TB Seagate FreeAgent Drive. OK, the FreeAgent drives aren't the quietest external ones but I can clearly say if it is running or not.
 
gmutale said:
I have done hotswapping both in my file server which has a single rail PSU & in my main rig which has a dual rail PSU.. every time I unplug & plug in a HDD, other HDDs momentarily lose power - enough for RAID arrays to degrade!

I may in the future get a Norco 4224... how does one hotswap HDDs without other HDDs losing power? :confused:

TIA
Click to expand...

By using a PSU capable of running your machine and not skimping out. Never had any trouble hotswapping in my machines... Or you have a really cheap backplane, or both.
 
Status
Not open for further replies.
Back
Top