Build or buy a NAS?

runningincircles

Limp Gawd
Joined
Jun 25, 2001
Messages
247
Environment:
27 inside employees
66 Outside employees (Connect via SSL over ports 80)
Windows Server 2008 on all servers
Windows XP SP3 on all local workstations
HP Procurve 2650 Switch (To be replaced soon with a Gigabit switch)

Background
Currently our file storage resides on the same server as our SQL database. Since a very large growth spurt we are now having a decent slow down of both of these roles. I would like to offload file storage to a NAS for redundancy and to separate the roles. Our world is a paperless one so we are heavy PDF users. Our current growth in PDF files alone is about 2GB per month.

Wants:
Raid 5 (Hardware Raid I assume would be better but is the cost worth it?)
Shadow Backup of four servers with about two weeks of good archives (No one takes longer than that for vacation so that is where I derived that length of time)
Good Longevity of array (I've read reviews of several NAS boxes and a recurring theme is multiple drive failures to the point that the array is destroyed)
Dual GB NIC (How beneficial is this utilizing load balancing, and will the Dell 48 Port GB switch be a good fit?)
2TB available of space
Rack Mount up to 4U of space
Drives that Support RAID as to not run into the Time-Limited Error Recovery issue (I'm not scared to flash them unless it requires modification of some sort)

BUDGET!
Around $2,000.00 If If your suggestion is over please elaborate as to why the extra $$$ is worth it. I will be ordering these items this week I hope as the project will be coming up soon and I want time to test. Thanks for your support and input!
 
Should be very possible. I always like building my own as much as I can, usually much easier/cheaper to replace parts. You can use the highest quality components as well. And its usually cheaper.


  • I don't think dual GB/TOE will necessary, but maybe. Your bottleneck will much more likely come from your internet connection upload, since it sounds like most of your employees are remote.

  • I think hardware RAID would be a good investment, but I also think software RAID would work fine, and help keep you closer to your 2k budget.
  • Is licensing free? If you have to cough up 1k for windows license, you could look at other free OS's

  • Since you're all windows, I'd consider sticking with that and using s2k8 , assuming your computers are all on a AD domain.

  • Assuming we're going software RAID, the simpliest way to do it is have 7 disks, 2x1TB in RAID1 partitions with hot spare for data, and then two disks for OS and VSC. If you need more space, add two more disks later in R1.

  • I'm a little reluctant to use 2TB drives, I've heard/read lots of things about a disproportional number of drive failures vs 2-3 platter drives that are 1TB or less.

  • If you're going with hardware RAID, get 8 disks and use RAID6 + hotspare, + a good areca or 3ware controller. Areca controllers are usually preferred, but I've been using some 3ware controllers and have had good luck with them so far.

  • I've had good luck with WD enterprise drives [RE series].

The 2x1TB in R1 might sound stupid to some people here, but as far as disaster recovery goes, It's usually pretty painless to put 1/2 drives into another server with Intel software RAID, and get data off of them.
 
Last edited:
How big are the PDF's, and how many users are concurrently opening PDF's? How are they accessed (is a a shared directory/ database/ web representation of a file structure?)

What is your total expected NAS storage need currently and what is the total storage growth rate (2GB/mo is very little), excluding redundancy/ backup?
 
Exchange Server 141GB
PDC C: 64GB
PDC D: 307GB
App Server 42GB est
Web Server 36GB est

Total Used 590GB

I am definitely open to a free O/S to help me get to a hardware raid and stay close to budget. If there is room however I would like to have s2k8. All systems are members of an AD. When I said 2TB I meant total and not per disk. I will be moving all local user folders and profiles to the new nas. Currently everything is stored on their local machines. I would estimate 2-4GB per machine so on the high side add another 100GB to the 590GB total. That would put me at about half full after making server backups. The PDF files are accessed via local share, the database, and one proprietary application via IIS/SSL. They range in size from 1 - 100MB. Concurrent users are probably around 30-60 during the busiest part of the day but a good portion of that is database and not PDF.

So after reading up on raid 6 it appears to be a safer bet with sensitive data. Utilizing 7x500GB drives the array would be 2.38TB? (http://www.grijpink.eu/tools/raid/index.php)

I would love to hear some opinions on drive choices but I know a lot of that will depend on which card I go with. Assume that I want an 8x sata pci-e controller and proceed from there. Which free O/S will be the easiest to work with and configure? I only have experience with Windows systems so far.
 
ZFS with a cache device would be a great setup. But i'm under the impression you do not prefer a UNIX OS like FreeBSD. Instead, you could look at FreeNAS. It has an older version of ZFS though, and doesn't support cache devices. Newer FreeNAS 0.8 will have newer ZFS version as well.

FreeNAS is an easy-to-configure web-GUI OS based on FreeBSD. It cannot be used easily for other purposes than serving files over the network, though. But it does support all protocols and should be quick to setup.

I should point out that the ZFS version used by FreeNAS is still labeled as 'experimental' and quite a few fixes were made in the 'stable' ZFS port in FreeBSD 8.0 and later. If this is for serious stuff, i would carefully test and be very reluctant with upgrading FreeNAS; always make a FULL backup of your data. Two separate systems may be preferable.

Also, if you do not need that much data, i would consider 4 disks of 2TB, in a mirror configuration. Alot simpler than RAID-Z and you can expand with 2 disks (1 data 1 mirror) every time, which is nice should you ever need more data. Also 4 ports means you do not need any controller; just the onboard ports if you pick a motherboard with 6 SATA ports.

Building yourself does carry the risk of anything 'strange' going wrong; though the same could be true about some commercial NAS systems which may have weaknesses. Ultimately, depend on a good backup solution and invest in a backup server to take over work should the first fail. That makes it more resilient to failures if you feel that is important.
 
For business, I do not mess around too much with home grown options. I always include it in the write up options but it's almost never used unless the project is an emergency. I understand that saving money is on the minds of everyone today but it should be more about an investment in options and growth.

1) Get something that is very easy to grow. Data storage grows endlessly. Once you create a new solution that people love, they will use it.

2) Get something that just works. Thinking about fixing an issue at 10pm on a Friday is hard when everything is closed for the night/weekend. This is where "paying a premium" comes into play. If something breaks and you need it fixed ASAP, you end up paying a high price to get it now. Waiting for three day shipping hurts when something is down or degraded.

3) Satisfying the boss. Saving money is the easy way to make the boss happy. Telling the boss that it will cost a little more now to save a lot later works too, (but may require a few beers first.)

4) Easy to Manage. If you are the system admin, get something easy. Why spend hours research forums to fix a software issue when you can have hardware do the job for you. Software raid is inexpensive until something happens or you need to change the initial setting. Expanding a software raid may be easy for some but it only takes one mess-up to kill it all.

I recommend getting an HP/Dell/<blah> 2U server:
Example:
http://h10010.www1.hp.com/wwpc/us/en/sm/WF25a/15351-15351-3328412-241644-241475-3949986.html

They come less expensive but starting at $2,000 you can get a 2U server chassis that can grow. Need more space, faster CPU, more RAM? open the case and throw it in. Something breaks? Get a replacement sent to you before sending the bad one back to them. The HP server comes with hardware raid, low end or premium SAS drives, and enough network and power without any guessing. Two 15k SAS drives can push 250-300MB a second in our HP servers easy. (with the right controller, data, and cache) Need more space? add an external drive array or throw more drives into the chassis.

From here, it's almost endless what you want to do. You can install windows 2k8 and use its services or HyperV. I would use ESXi and start carving out space per use case.

I hope this helps. Everyone has individual taste on builds and growth. If it was a home build and I was the only person who could yell at me, off the shelf is great. When someone else or the boss can yell at me, it better just work.
 
+1 for buy not build when it comes to business.

Also remember RAID is not backup. RAID is for uptime, Backup is for data security and you need to do both. (I only mention this because you don't mention how you plan to back your data up)
 
I would echo fewer drives (opting for 2TB or 1.5TB drives over 500GB drives). The lower cost of adding ports plus fewer drives = lower power consumption.

You are pretty close to being able to do 2x 1TB drives in Raid 1 + backing up to a second Raid 1 array (assuming you couldn't use a second system). Another option is 2x 4 drive raid 6 arrays since you can have any two disks fail versus Raid 1 where if both disks fail you are toast.

Budget wise, you are probably below any dedicated NAS hardware that is worthwhile. Maybe an entry level Dell + some extra disks and setting it up as a NAS. Two redundant machines are going to be out of the budget though.

FreeOS wise... Other than FreeNAS, Openfiler would work OK also as it is the Linux based competitor to FreeNAS with a WebGUI. No ZFS, but it is Linux.

One thing that would push me to Dell or HP is that you can get a warranty, support, and service. If something goes wrong, you can point to a Tier 1 OEM and identify the screw up. If you build yourself, you are the only one to point the finger at if something goes wrong. That is a fundamental question. Your performance needs and storage capacity requirements can be met very inexpensively.
 
I like building my own, usually get hot swap trays to go with it. Though I really love the look of this case, may be my next case:

http://www.newegg.ca/Product/Product.aspx?Item=N82E16811219033

Good price too, most other rackmount cases that I've seen are over 1k.

I guess the issue is finding a motherboard and/or controller(s) that have enough sata ports to handle those bays. Buy a few drive at once and tons of room for expansion. I'd probably use MD raid, or maybe freenas.
 
Back
Top