Recent content by syoyo

Ah, I see. How about much more *blocksize*? e.g. 128MB. FYI, NFS/RDMA seems not stable before OFED 1.5.4. You'd be better to use OFED 1.5.4 or later, but in this case, most verbs application doesn't work with Solaris IB(e.g. ib_read_bw)

Yes, you can also buy much more cheap IB switches on eBay. I once bought 8-port IB SDR switch for $200, and also bought 10 IB SDR card for $200. Its $25/port, $20/HCA. Its mostly same price of 1GbE. Cables was also around $10 ~ $20/cable.

4 dd threads, each of 1GB data, as you did. I have no idea how to check LinkSta on OI. I checked it with lspci by running Linux(CentOS) once and confirmed 5GT/s, x8 LinkSta. I don't know how to set PCI-e message size to 256B, will try to find it if I have time. FYI, I am running ZFS +...

Congrats! Numbers are pretty nice! Why you just test NFSoRDMA with 1M of data? I guess you have to send much more data, otherwise the overhead of filesystem will limit the bandwidth.

Congrats! > 822MB/s * 4 (threads) = 3288MB/s BTW, I got success to run SRP target on OI151a + ConnectX QDR, and get around 1.2GB/s bandwidth. My mobo's chipset seems limiting internal bandwidth by 20Gbps, so I cannot get QDR peak, but guess your facility could. Hope hearing your success of...