newbie question about raid/sas configuration and calculation

Joined
Apr 17, 2012
Messages
6
Hi guys,

I'm new to using RAID, expander cards, and enclosures, I was hoping that someone might be able to help me build a system for my home.

I have a bunch of hardware and disks lying around, different manufacturers different sizes. After some digging, here's what I roughly came up with.

- LSI MegaRaid 9260-4i
Internal Port 1x SFF-8088

- ChenBro SAS Expander Card CK12803
Internal Port 1x SFF-8087 (TO RAID CARD), 4x SFF-8087 (TO BACKPLANE)
External Port 1x SFF-8088 (IN?), 1x SFF-8088 (OUT?)

- Norco RPC-4220
4U, 20 hotswap, etc. etc.

1) I understand both RAID/SAS expander cards can accept SAS/SATA3/SATA2 harddisks, but can it support a configuration like this simultaneously?

- RAID 10 for 4 SAS harddisks with 1 hotspare on standby
- RAID 5 for the remaining 6 SATA2 and SATA3 harddisks

2) Assuming that I have set this already setup, how do I add more harddisks after I run out of space? Is it as "simple" as buying new harddisks of the same size, putting them into the enclosure, reboot the system and go back to the RAID management screen in the bios?

3) Is it possible to mix and match the SATA2/3 harddisks of different sizes into the RAID5 configuration? Is there a better configuration to be able to add more cheap harddisks as and when I require?

From the 9260-4i specsheet, it says the data transfer rates is up to 6Gbps per port. How do I calculate the theoratical max data rates?

4A) 9260-4i to fanout cable to 4 SAS 6Gbps drives:
= 4 drives x 6 Gbps ?

4B) 9260-4i to 3Gbps SAS Expander to 4 fanout cables to 4 SATA3 6Gbps drives:
= 16 drives x 3 Gbps?

4C) 9260-8i dual linked to 3Gbgps SAS Expander to 4 fanout cables to 4 SATA3 6Gbps drives:
= 16 drives x 3 Gbps x 2 links?


5) From the wiki, I gather PCI-E v2 is 8GB/s, which is 64Gbps. How possible is it to reach this limitation? When I have reached this limitation, is the cheapest method to expand this configuration?

6) Incidentally, I realise the chenbro sas expander card has 2 external ports, one is in and the other is out. How do these work?

Thanks in advanced for any answers that anyone can provide!
 
why need expander card with norco

sas to sas cable with norco. they tell u on their site which cable u need if connecting to sas hba
 
general rules for raid

1) dont mix differing drives in the same pool/raid/group of disks
2) read rule 1 you 'can' do it but dont.

your questions

1) mixing raid levels on the same controller that shouldn't be an issue as long as the controller supports it. pretty sure that one will support it just fine however, refer to raid general rule 1 for the raid 5.

2) uhmmm ... for that specific controller i'm not 100% positive that it does online resizing but it might. meaning, plug in the new drives and reconfigure the raid, this requires a software component which will likely be available for linux/windows meaning you dont have to reboot.

3) 3 yes, but again, rule 1. also, the raid will default to the smallest drive size. so if you have 1 1TB drive and the rest 3TB drives it will default to using only 1TB per drive.

4) bandwidth is per channel/lane. those fanout cables are 6gbps per channel or 4 x 6 = 24gbps. if your card has 2 of those prots, 48gbps, 4 ports, 96gbps.

5) PCI-Ev2 ... depends on the number of lanes. each lane can do 500MB/s and 5 GT/s. not sure where you got your numbers but they're way off. a 16x PCI-E 2.0 slot can do 8GB/s @ 5 GT/s. with spinning disks it isn't likely you'll ever run into this limitation as a bottleneck. 6gbps SSDs will bottleneck the moment you try to drive more than 1 per SAS/SATA lane though.

6) they allow you to daisy chain more disk chassis. typically 4 per daisy chain. however unless you're doing all SAS you're going to run into problems.
 
1. Absolutely!
2. Pop in the drive (I'll assume everything is hotswap) and start an OCE (online capacity expansion) using a CLI or GUI management tool (megacli/MSM for LSI). After that is done, resize the partition and filesystem to match.
3. If you can, I do not recommend it. Make another array of new drives or buy additional drives of the same model you already have.
 
@all
Ok it seems that I should not mix different types of drives (as per RAID). Thanks for the info!

@pitne
There's a typo up there, the LSI MegaRaid 9260-4i has only one SFF-8087, so I would have to connect that to an SAS expander, and from the SAS expander I need to connect SFF-8087 to SFF-8087 to the backplane right?

@madrebel

general rules for raid
4) bandwidth is per channel/lane. those fanout cables are 6gbps per channel or 4 x 6 = 24gbps. if your card has 2 of those prots, 48gbps, 4 ports, 96gbps.



7) I'm sorry I don't get this, does this calculation include the SAS expander? ie does this count as 4 or 16 channels/lanes? (Sorry for the bad drawing)

1 x RAID Controller (with 1 x 8087 port)

|--> 1 x SAS Expander (with 4 x 8087 ports)

|--> 4 x SATA3 6Gbps drives
|--> 4 x SATA3 6Gbps drives
|--> 4 x SATA3 6Gbps drives
|--> 4 x SATA3 6Gbps drives​

Total theoretical transfer speed = 6Gbps x 16?


Additionally, if I manage to find a RAID card with 2 x 8087 to connect to an SAS expander:

1 x RAID Controller (with 2 x 8087 ports connected to the Expander)

|--> 1 x SAS Expander (with 4 x 8087 ports)

|--> 4 x SATA3 6Gbps drives
|--> 4 x SATA3 6Gbps drives
|--> 4 x SATA3 6Gbps drives
|--> 4 x SATA3 6Gbps drives​

Total theoretical transfer speed = 6Gbps x 16 x 2? (32 lanes?)

6) they allow you to daisy chain more disk chassis. typically 4 per daisy chain. however unless you're doing all SAS you're going to run into problems.

8. How would this work? I have another chassis containing only drives and an expander? Or is there an OS with a motherboard on it? Would it go into the "IN" or the "OUT"?
 
total bandwidth is how many ports you have on the HBA. each 8087 port is 24gbps. expanders dont increase this.

in from the hba or upstream chassis. out to other chassis. just boxes with drives and expanders.
 
Back
Top