so i'm thinking of doing raid 10 on onboard sata ports on a b85 chipset board, it has 4x6gbps, and 2x3gbps ports.
my current thinking is that i should be able to max out my 4x pci-e infiniband ddr connection port with just 3 120gb ssd's for reads at least. but i was reading there's bandwidth limitations on intel pch that should limit to 2GB/sec, which is what i'm at with 4x pci-e as well, but can only push 1400MB/sec. i know i can swap the video card and infiniband card around to raise infiniband back to around 1600MB/sec, but i'm wondering if raid is going to hit the same limitation, and whether or not i should be thinking about 4x120gb ssd's to max out 1400MB/sec. in a way using 3 ports, means i can do 3x hard-drives further down the track if i want to at the same time. the idea would be to use the linux "far=2" option which means that all drives are read from at the expense of slower writes (although I dunno how much slower writes will be if using ssd's), and linux's software raid seems to be the only easy way to raid 10 on 3 drives. i'm also wondering idlely if running at peak speeds will impact anything else negatively. i imagine the same bandwidth is shared with usb, ethernet, but i don't think that should matter. i can't add a pci-e sas controller for more bandwidth, as it's a microatx board with only 2 pci-e x16 one with the x8 infiniband card, and one with the x16 video card. and the second pci-e x16 slot only runs at x4.
and this is a haswell board, but it looks like bandwidth hasn't increased since sandy bridge.
my current thinking is that i should be able to max out my 4x pci-e infiniband ddr connection port with just 3 120gb ssd's for reads at least. but i was reading there's bandwidth limitations on intel pch that should limit to 2GB/sec, which is what i'm at with 4x pci-e as well, but can only push 1400MB/sec. i know i can swap the video card and infiniband card around to raise infiniband back to around 1600MB/sec, but i'm wondering if raid is going to hit the same limitation, and whether or not i should be thinking about 4x120gb ssd's to max out 1400MB/sec. in a way using 3 ports, means i can do 3x hard-drives further down the track if i want to at the same time. the idea would be to use the linux "far=2" option which means that all drives are read from at the expense of slower writes (although I dunno how much slower writes will be if using ssd's), and linux's software raid seems to be the only easy way to raid 10 on 3 drives. i'm also wondering idlely if running at peak speeds will impact anything else negatively. i imagine the same bandwidth is shared with usb, ethernet, but i don't think that should matter. i can't add a pci-e sas controller for more bandwidth, as it's a microatx board with only 2 pci-e x16 one with the x8 infiniband card, and one with the x16 video card. and the second pci-e x16 slot only runs at x4.
and this is a haswell board, but it looks like bandwidth hasn't increased since sandy bridge.