Passthrough of NIC causing Timouts

Joined
Nov 17, 2011
Messages
3
Hello,

i have a problem with passing a NIC to a FreeBSD virtual machine.

First of all my Specs:

CPU: Intel i5-2400s
MB: Intel DQ670SW
RAM: 16GB TeamElite
RAID Card: Dell Perc 6/i IT Mode
ESXI Version: 5.0




NICs:
Onboard: Intel Corporation 82579LM Gigabit Network Connection
PCI: Intel 1000 Pro/GT 82541PI Gigabit Network Connection
The nic driver for the onboard nic is chilly's driver provided in this forum.

Setup:
Pfsense vm is nat between virtual machines on esxi host and regular network. the vmnic1 is connected to the regular network.

There is a freeNAS virtual machine which owns the raid card via pass through, which is working fine. For better performance i wanted to pass a additional nic to the virtual machine(The PCI Nic). The nic was recognized flawlessly by freenas.
But then the problems started. I had timeouts spontaneous timeouts on both interfaces to the regular network.
These timeouts do not occur simultaneously, which makes it hard for me to trace it.

Setup:

network1 ---> vmnic 1--> onboard nic --> physical network A
|
pfsense


network2
|
pfsense
|
freenas --> passthrough intel nic --> physical network A
|
other vms

The problem disappears if i use a virtual interface pointing to network1, but the permance is quite poor then (~30MB/s instead of 80+MB/s). I changed cables and network equipment, but i didn't help either.
I don't think the problem is because of the custom driver for the onboard nic, it works fine as the primary interface.

My vmkernel.log: vmkernel.log


My question is now: Has anyone of you experienced a similiar behaviour somewhere?
It would help a lot if I could solve this problem.

Thanks in advance,
fire
 
I don't see passing through a NIC to be worth it here. You won't see any real world diff in this sort of arrangement. I'd try to figure out why perf is so bad with a virtual NIC. What virtual NIC are you setting it for? For FreeBSD I'd suggest e1000.
 
In general, I"ve had the best results with e1000 on all guests I have used (freebsd, centos, ubuntu, xp, win7 and opensolaris.)
 
Yes, i use e1000 on all nics. What is your performance there? Before i installed ESXi, i tried the FreeNAS setup directly on the machine. I had ~90MB/s throughput when writing to disk.##

Are those virutal nics usually performing better than here?

Maybe I'll try passing the nic to an other virtual machine and check if the same timeouts occur again.

What information could help you here? I'll try to provide it as fast as possible.

Thanks so far..
 
Unless you're doing a crazy number of small network I/Os doing pass-through on a NIC really isn't worth it. You can easily max a 1Gb link using a virtual NIC. You'll almost never see VMDirectPath used in a production environment...just not needed.
 
90 MB/s is like 800mb/s when you consider protocol overheard. Nothing wrong with that thruput. Between VMs on the same hypervisor, I can get 3-5gb/s sustained thruput using the e1000.
 
90 MB/s is like 800mb/s when you consider protocol overheard. Nothing wrong with that thruput. Between VMs on the same hypervisor, I can get 3-5gb/s sustained thruput using the e1000.

But i only get 20-30 MB/s from freenas to my regular network over the virutal e1000. :/

Your idea brought me to test the performance via iperf. Between virtual machines i get 2.42 Gbits/sec.

Between pfsense and the regular network i get 867 Mbits/sec

Between freenas and the regular network i get 643 Mbits/sec.

It looks like the cpu on my laptop is limiting the transfer using iperf.

Ok. It looks like the fail is depending on freenas. The raid can't be the limiting factor, cause I get write/read speed >300MB/s on with dd over a 100GB Block.

So it looks like there is some misconfig in freenas. Do you agree?

Thanks for your help,

fire
 
Last edited:
Back
Top