I'm going to be adding to this and updating descriptions. I'm selling my Dual Opteron server. I've downsized everything to a Haswell box plus a couple Azure VMs.
#1-- Gone!!
Adaptec 71605Q card; no cables, includes cache module and capacitor...
With the exception of some of my coworkers, your campus network is the only thing I truly miss about my former employer. Single homed ICN just isn't the same!
#1:
SolarFlare SFN5122F dual port 10gbe NIC - this is a PCIe card that retails for a lot of money. Works with Windows, Linux, and vSphere... maybe others. It requires fiber SFP+'s. As far as I can tell, its not too picky about them. $300 shipped.
#2
10Gbase-SR SFP+'s. I have an Intel, Oracle...
The snapshot would give a crash consistent view of things, as if the power cord were yanked from the box with the volume mounted. The desirability of such a thing depends on the running apps.
Why would iSCSI be limited to Windows boot? It could be used for storing VMs for vSphere or Hyper-V...
Why not? You still get all the checksuming, caching, and RAIDZ advantages with ZFS LUNs that you do with ZFS files. Compression and dedupe work just as well. So do snapshots.
Why not consider ZFS on Linux or old school reliable MDADM raid with the SCST iSCSI target? Alternatively, you could use KVM and map a LUN directly into a 2012 VM.
Stuff that costs a pretty penny isn't good for small business. They don't want to pay monthly fees running into the hundreds for cloud services and then have to depend on India for support. Having things local with a relatively automated backup that can be taken offsite is much preferable.
FWIW, I have had excellent luck with my collection of Seagate 2tb and 4tb drives in HP and SuperMicro rack enclosures in 8 and 12 configs. Also, their 1tb 2.5" drives in ProLiant DL360G6s have been good for me. I have had maybe 2 failures in 24/7 use over the past 2 or 3 years. None were "RAID"...
http://www.provantage.com/crucial-technology-ct480m500ssd3~7CIAL74H.htm (mSATA)
http://www.provantage.com/crucial-technology-ct480m500ssd1~7CIAL73U.htm (2.5")
Roughly $25 difference. It really depends what you want to do with your storage.
I have one attached with an HP SAS HBA which is based on the LSI2308 chip. I see all 12 drives.
The SAS Expander firmware can only be updated with a HP SmartArray card, much like the standalone HP SAS Expander card.
I haven't tested with over 2tb drives, so I can't vouch for their stability...