So I scored a couple of connectx-2 VPI cards off ebay. One in a vsphere 5.5 box, the other in a storage server (running a linux variant). On the latter, I have to specify whether I want CM or UM, and therefore what MTU to use. Works just fine. I was able to get vsphere working in IPOIB UM mode by setting the MTU to 2044 and it worked fine (although the performance was mediocre, as I was told it would be.) What is puzzling is that I can't seem to find any documentation or howto on how to set vsphere up to use CM. I know I need to set the MTU much like (I think 65520), but surely it can't be that simple, as you need to specify other things on linux (like what mode to use!) Does vsphere even support IPOIB/CM? If so, how the heck do you configure it? At the CLI? Some other way?