VMware ESXi Storage Server/SAN

[cybertron]

Hey guys, i'm in the process of researching a project I'd like to complete in the next few weeks, and I'm having a bit of a hard time finding all the info I need.

In short, I'd like to build an ESXi server for the purpose of testing SQL clusters, 2008 server clusters, AD, etc, etc. Basically a learning lab. I can see running 8 machines at the same time at any given point. I'd also like the option to sell this setup to a client down the road if I find myself not using it enough. So it needs to be semi-enterprise class. So all of this will be rackmount. Please understand that I'm not looking to build a $10k server, but something middle of the road.

My two basic options are to create a single box with maxed out cpu/memory/HDD(raid,etc), and the other is to create a box with all HDD's, plus a decent ITX mobo to serve as an iSCSI SAN. (if that would even work).

I'm leaning toward a SAN + ESXi server though because down the road it could work out to be a HA ESX server config for a client.


For the ESXi server, I'll get some kind of quad core cpu, 16gb ram, etc, etc.
For the SAN side of things, I'm thinking 3x Supermicro sata/sas enclosure with a total of 15 drive bays. This san will also be my storage box (currently a 4TB 2U box). So I'm thinking 6x 1TB or 2TB in RAID5 or 6. I can handle all of those details.

The details I'm not so familiar with are how to configure the VMFS LUN/Array. Fiber Channel is out of the question, it's just way to expensive, and SAS is up there, but 4x 147GB would be doable. or possibly 4x SSD. Both of these would be in RAID10 (?) to gain the most performance out of them. The questions I have are all about performance for these 4 or so drives in whatever type of raid will get me the best performance.

Can anyone suggest what would be the best way to build this myself? I understand ESX(i) has very strict hardware requirements, but I plan on following the HCL as well as others experience.

 

[nitrobass24]

Well for your datastore i would definitely only use RAID10 not 5/6.
Now as for what to buy that depends heavily on
1) how much space do you need?
2) how much money do you want to spend?

 

[cybertron]

Well for your datastore i would definitely only use RAID10 not 5/6.
Now as for what to buy that depends heavily on
1) how much space do you need?
2) how much money do you want to spend?

If I'm running say 10 VM's at the same time, or even just a set of 10 that I test with, I really cant see needing over 250GB-500GB. And money, on just these things, I'd like to keep it under $800 ($200 SSD x 4).

Would I get acceptable performance out of a normal 7200RPM Sata drive in RAID10?

 

[dandragonrage]

Unless you intend to use multiple VM boxes and use VMotion (which isn't free to use, as far as I know) and all that stuff, SAN isn't going to have any advantages over local storage.

 

[nitrobass24]

Id get 8x 147gb 15k SAS drives before i got 4x 120gb SSDs for a VM setup.

Good* SSDs are going to be way more expensive than a SAS setup.

 

[cybertron]

Unless you intend to use multiple VM boxes and use VMotion (which isn't free to use, as far as I know) and all that stuff, SAN isn't going to have any advantages over local storage.

Well, that's the goal at some point. I'd like to have that option if I ever move the box to my space in a datacenter. Plus, I'll be using an array for storage of local files, but I guess that wont make any difference... could still share that from a VM.

 

[cybertron]

Id get 8x 147gb 15k SAS drives before i got 4x 120gb SSDs for a VM setup.

Good* SSDs are going to be way more expensive than a SAS setup.

Can you recommend a drive specifically? I know little about SAS besides them being expensive. Also, as for heat... am i asking for trouble with these drives?

 

[dandragonrage]

Okay, if you're going to use the benefits of SAN then go for SAN.

You should have some fans in the case with the drives. It shouldn't be a problem. Google tested hard drives a while back and did not find adverse reactions to moderate heat. Basically any brand of SCSI drives are good. I was always partial to Fujitsu, personally, but I haven't used SCSI in a few years so Seagate may have leapfrogged them.

 

[cybertron]

Okay, if you're going to use the benefits of SAN then go for SAN.

You should have some fans in the case with the drives. It shouldn't be a problem. Google tested hard drives a while back and did not find adverse reactions to moderate heat. Basically any brand of SCSI drives are good. I was always partial to Fujitsu, personally, but I haven't used SCSI in a few years so Seagate may have leapfrogged them.

Well, I'm still learning what a "SAN" is, so I'm not sure if this would be a hybrid or just a NAS. But I'm thinking it will have all the drives, an ITX board or other mini-atx with a hardware raid card. I'll setup 2 Arrays, one for VM's and one for storage. I'll share the storage over samba and the VM array over iSCSI (VMFS?). Still researching as you can see.