• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

Team Nic

J

jsvensson

n00b
Joined
Mar 3, 2012
Messages
23
Hi guys,

I have a weird problem - either I dont get the basics of team nic, or something is fishy in my setup...

I have 2 servers with 2 gbit nics each connected to a hp switch. file transfers max out at 60 gb / sec...and now config changes seem to make it faster....

Server 1 - (core I7, 18 gb ram, SSD, 6x sata disk array zfs mirror, intel dual gbit nic, solaris 11.11.11) Nics cinfigured as agg L3, static (or off)

Server 2.- (intel mobo, 1x xeon, 8 gb ram, 2008 R2 server, 7 sata disk array raid5 + spare, intel dual gbit nic on mobo) nics configured as LACP with intels teamnic drivers.

Switch - hp procurve 1810g 25 - 2 wires to server 1 and 2 wires to server 2, 1 wire to router. 2 trunks configured.

Question 1 - is it possible to max out the speed on 1 file transfer or do I need to measure with more concurrent streams/transfers?

Question 2 - what is the best configuration - LACP? active? static? What am I misisng?

Question 3 - Which bonding mode is best for maxing out speed? Dynamic link aggregation (802.3ad)? Adaptive load balancing?

Thanx for helping out...im lost here.....


//J
 
do you mean 60Mb?

What I have found with the LACP on my HP switch is it seems to be active passive.

try moving more than one file at a time and see what you get.
 
If i copy 2 files I get about 50mb /s on each transfer...

Is there any setup configuration to optimise 1 transfer, i.e. to use all links in an team for 1 transfer?

/j
 
802.3ad is pretty good. I have a v1910 I set it up with QNAP I see burst rates as high as 167mb/s
 
Ok, but do i understand it correct - 1 file copy = one stream = cant surpass the speed of one link in the trunk? any way to get past that?
 
Theoretically but not practically for most applications, they'd either have to be written to recognize LAG and open up 1 connection per link at different parts of the file. Other than it being "cool" to have over a 1Gbit link per transfer there's not much real practical value in this. Your main problem isn't LAG not working it's you're only getting 60MB/s on a 1Gbit link when you should be getting closer to 100-120MB/sec, so something is giving you a huge bottleneck somewhere.
 
Thanx Dragon...the more I read the more it seems as the max i can get on file transfers is 1 gbit.

I am using SMB between servers. another relly weird thing is that nfs gets me 12-20 MB/S....

I checked if the CPU is the problem but it maxes at 4-5%.... also the disks on the 2008 R2 machine read at 3-400 mb/s

Any ideas where to start?
 
There is no standard way to do a LAG and use more than one link's connection on a single transfer. It's all in how the connections are hashed across a link. Normally you hash by MAC address, IP address, or combo of IP/port. All of those stay the same for a single connection. There are some non-standard configs that will let you do it with a single connection but again, non-standard and only supported on a few switches...not on a 1810 or anything Cisco. The reason is that they mess up frame delivery order which can be really bad for some protocols.

My Synology DS1511+ has two NICs in a LACP group. To max them out I have to do multiple connections. A single connection from one of my vSphere hosts with 4 NICs in a group won't do it...only max a single NIC's connection.
 
I think I figured out the real culprit.....

When I copy with windows regular file copy it maxes out at 112-114 mb/s...
When I copy with TeraCopy it maxes out at 60-is mb/s....

The reason for all this is that I need to copy huge ammounts of data from win to solaris and the speed difference means that it takes days not weeks to finish....

which brings me to the next question - what is the best way to copy huge ammount of files and make sure that everything is copied....rsync? teracopy? ....
 
A days worth of data on a single 1Gbit link is over 8TB, your smallest server has 6 drives and even @ 3TB per drive you're still looking at 2 days of data transfer max... assuming completely full drives and 0 redundancy.
 
jsvensson said:
Team Edward?
Click to expand...

He's basically saying he's coming out of the closet. Edward Cullin from Twilight. Team Edward vs. Team Jacob - Vampire vs. Werewolf. Team Nic. It's simple. And holy shit - I can't believe I know that crap. My wife has all the current ones on Blu-ray, and she tells me about them, I swear.
 
You must log in or register to reply here.
Back
Top