hokatichenci
Gawd
- Joined
- Oct 28, 2004
- Messages
- 722
I've got my two systems, each with 4 gigabit ports, 2 from skge/forcedeth and 2 from the Intel Pro/1000 PT Dual Port Server card (bonded into two different virtual nics using roundrobin). Linux 2.6.18. The Intel nic's are connected to each other using a crossover, so they are directly connected using an MTU of 9000. When I run iperf for a short amount of time (~5s), everything is peachy - 1.8-1.9gbit and lookin pretty. When I bump it up to about 15-30 seconds, performance degrades very quickly. It'll go from 1.8gbit to 800mbit, even 500/400mbit. Sometimes it'll report outrageous numbers like 10-50mbit. I'm thinking that something is going on and the longer I run it the greater chance that something bad happens. I've tried multiple TCP congestion versions (bic, highspeed, reno). I'm not maxxing out memory or CPU - cpu stays stable around probably 30-40% with jumbo frames enabled (80+ without). I'd like to move to 4gbit connections by this weekend, so any help/suggestions would be greatly appreciated.
Here's an example output:
Here's an example output:
Code:
iperf -s
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 85.3 KByte (default)
------------------------------------------------------------
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3044
[ 4] 0.0-10.0 sec 2.22 GBytes 1.90 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3045
[ 4] 0.0-10.0 sec 2.15 GBytes 1.85 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 4795
[ 4] 0.0-15.0 sec 3.23 GBytes 1.85 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 4796
[ 4] 0.0-15.0 sec 3.19 GBytes 1.83 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 4797
[ 4] 0.0-15.0 sec 3.32 GBytes 1.90 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3968
[ 4] 0.0- 5.0 sec 1.08 GBytes 1.85 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3969
[ 4] 0.0- 5.0 sec 1.04 GBytes 1.79 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3970
[ 4] 0.0- 5.0 sec 1.03 GBytes 1.77 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3971
[ 4] 0.0-20.0 sec 333 MBytes 140 Mbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 2837
[ 4] 0.0-20.0 sec 376 MBytes 158 Mbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 2838
[ 4] 0.0- 5.0 sec 1.09 GBytes 1.87 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3988
[ 4] 0.0- 5.0 sec 1.11 GBytes 1.91 Gbits/sec
[ 4] local 192.168.1.10 port 5001 connected with 192.168.1.11 port 3989
[ 4] 0.0-30.0 sec 2.46 GBytes 704 Mbits/sec