Consequences from maxing out the PCI Bus?

Joined
Jun 17, 2004
Messages
43
Hi guys,

I'm setting up a bit of a lab to play with iSCSI and I've got a bunch of PCI network cards laying around that I'd like to throw into my servers.

My only concern is whether it'd be bad (ie, data corruption) for me to put three gigabit PCI network cards in the same machine. There'd be nothing else accessing the bus, but since each card would (theoretically) use 125MB/s (ie 375MB/s total) and the bus caps out at 266.6MB/s, I'm wondering if this isn't such a hot idea. I realize that there's overhead to worry about and that I realistically wouldn't expect to see 125MB/s being used by each card, but my concern is with saturating the bus and it causing random performance degredation or data corruption on my iSCSI targets. Since I have the extra hardware laying around, I don't mind using a whole card if it'll let me get that last 16.6MB/s + 2*overhead of room within the bus as long as it wouldn't cause data corruption.

Can I put three gigabit PCI network cards in the same machine without causing a problem?

Cliff's notes:
- have tons of spare gigabit PCI nics laying around, want to use these instead of buying new PCIe cards
- each card would use 125MB/s of PCI bus bandwidth (minus overhead)
- PCI bus only has 266.6MB/s bandwidth available
Q : Would three cards (ie, maxing out the bus) cause me more grief than it's worth, or should I just stick to two cards?

I'd appreciate any other insights into this. I've considered buying other PCIe NiCs as well, but I figure I may as well use the older hardware rather than letting it go to waste...
 
No data corruption. You just won't come close to maxing out those cards. 266MB/s? Are you using 64-bit or 66MHz PCI? Regular 32/33 PCI only has 133MB/s.
 
As far as I know one pci gigabit nic will come pretty close to maxing out the pci bus. Like dandragonrage said regular pci is 133mb and if the each card can do 125mb you are pretty much almost maxed out.
 
Regular 32/33 PCI only has 133MB/s.

And that was in 1 direction at a time and shared with all other PCI devices on the same PCI bus. You are lucky to get 120MB/s. Do you have more than 1 PCI bus on the motherboard? That was only common on server/workstation boards.
 
I was getting the number from here (PCI 32-bit/66 MHz).

The boards are Asus M4A785TD-V EVO units, and unfortunately the specs don't clarrify whether this is a standard 33MHz or 66MHz bus. (For some reason I was quite sure it was PCI 2.2 (ie, 32-bit, 66MHz), but I can't seem to find that information at the moment.
 
It's 33MHz. You're not going to see better unless you go for a high-end server/WS board that has PCI-X.
 
Note that the PCI is a bus, so all devices on it share the same bandwidth (including for overhead). 3 gbe cards running full out would have a theoretical max of 25MB/s each sending or receiving.

Also, it's not clear if you're trying to aggregate the bandwidth of the cards together - this would require teaming/ganging which isn't supported by most desktop cards or switches (afaik).

I'm seeing about 30mb/s with ONE pci gbe card because the raid controller is also competing on that bus. This is an old D865 board (bad onboard jack) and intel pci gbe card and sata raid card on pci.
 
Last edited:
Back
Top