ITX ESXI server?

Q

Quartz-1

Supreme [H]ardness
Joined
May 20, 2011
Messages
4,257
I was reading this thread and wondered if it were possible to build a truly small ESXi test server. ITX based or smaller. 8-16 GB RAM, ~1 TB 2.5" HDD.

I lit on the Zotac ID81 and ID82, but they've got a few issues, like only one NIC. Unless ESXi supports USB 3 NICs.

Use would be as a test lab running assorted MS OSs, both client and server. Nothing intensive. I'll also be running VMs on my main box.

Since I'm aiming to remedy my cluelessness on ESXi, I'm hoping [H]ers can clue me in.

As for purchasing, I'm in the UK and preferred suppliers are Amazon, Novatech, and Ebuyer.

And yes, it must be quiet. :)
 
Last edited:
As an Amazon Associate, HardForum may earn from qualifying purchases.
Its going to be MUCH easier to just go with matx/itx Intel or atx AMD. Pro's and cons.

The easiest is a AMD system, 990 MB, 8350, 16-32gb, and most have IOMMU for passthrough. I also believe in another thread it was stated the MB's also supported ecc.
It will also allow a slot for a dual/quad port nic, graphics, and a raid card. Just find the smallest case that it will fit in.
 
Hagrid said:
Its going to be MUCH easier to just go with matx/itx Intel or atx AMD. Pro's and cons.

The easiest is a AMD system, 990 MB, 8350, 16-32gb, and most have IOMMU for passthrough. I also believe in another thread it was stated the MB's also supported ecc.
It will also allow a slot for a dual/quad port nic, graphics, and a raid card. Just find the smallest case that it will fit in.
Click to expand...

some mid to high asus amd motherboard model are officially support ECC memory where stated in the motherboard's manual.

that is the safe route.

990 support ECC memory, but everything relied on motherboard BIOS. some have unofficially supported, some disable ECC memory support.
which one to pick? just pick one and roll the dice.:p
 
Intel S1200KPR plus the CPU and RAM of your choice (though FWIW my CPU choice would be at least 2 actual cores, 4 w/hyperthreading).

The only issue with that MB that I can think of is that one of the NICs is not supported by ESXi by default, but there's instructions on how to add a driver for it. Since this is a lab box don't worry about ECC RAM.
 
Quartz-1 said:
The other issue with the Zotacs is the price.
Click to expand...
Quartz-1 said:
Where's your inner [H]? :)
Click to expand...

Sometimes your inner [H] requires deep pockets. :D
You really don't need to buy anything ...except a VMware Workstation License.

If your true goal is to run a few VMs running MS OSs, use your "Quiet PC"
and run VMware Workstation.

If you just want a small form factor hardware box to run ESXi but some
inner [H] adventure, get it to run on a new Mac Mini.

If you just want to piece together a system, I'd also recommend not going
with anything smaller than mATX - simply because anything smaller begins to
limit your possibilities ... with virtualization, memory becomes a limitation quickly.
Most current Mini-ITX systems are limited to 2 dimm slots and some of those are SO-DIMM.
You are starting off with a 16GB limitation off the bat with Mini-ITX (today)
 
BlueLineSwinger said:
Intel S1200KPR plus the CPU and RAM of your choice (though FWIW my CPU choice would be at least 2 actual cores, 4 w/hyperthreading).

The only issue with that MB that I can think of is that one of the NICs is not supported by ESXi by default, but there's instructions on how to add a driver for it. Since this is a lab box don't worry about ECC RAM.
Click to expand...

The only other issue I can see with that board is that it only supports 16GB, but you can't have your cake and eat it too, so you will have to make some concessions somewhere.
 
ashman said:
The only other issue I can see with that board is that it only supports 16GB, but you can't have your cake and eat it too, so you will have to make some concessions somewhere.
Click to expand...

Yeah, >16GB in mITX is a non-starter currently. But that's OK in this case as the OP stated 8-16GB support.
 
ashman said:
The only other issue I can see with that board is that it only supports 16GB, but you can't have your cake and eat it too, so you will have to make some concessions somewhere.
Click to expand...
And only 1 pcie slot, but I dont know if he plans to add more nics or a raid card, etc.
 
I am currently building two Citrix nodes w/ the Intel S1200KPR.
I have a build thread on STH.
 
BlueLineSwinger said:
Intel S1200KPR plus the CPU and RAM of your choice (though FWIW my CPU choice would be at least 2 actual cores, 4 w/hyperthreading).

The only issue with that MB that I can think of is that one of the NICs is not supported by ESXi by default, but there's instructions on how to add a driver for it. Since this is a lab box don't worry about ECC RAM.
Click to expand...


Also doesnt support VT-D which in Intel's great wisdom not an oversite... they wont fix it!


I am using the Foxconn H67s mobo, its realtec 8111e nic is identified as an 8168 by default, however doing my recent tests with NIC cards i have found it quite insufficient with the speed, i was getting with a Linux VM in it 35/MB Writes and 70/MB Reads off the one interface.

With my hosts with intel nics i was able to max out the nic 95-98MB/s on both read and writes...

The systems i have are running in my sig - Viper node using the antec ISK110 case, its SMALL/Quiet/Portable.. However with the Future of the NextGen VMware software i am re-thinking of going away from this design and onto more m-ATX systems... I want to get rid of my super bulky Rackmounts and quiet them down...
 
Last edited:
I mean is not having VT-d really that big of a deal? Other than for very specific one off instances will you ever want to use that feature.
 
Depends on what you do with your lab, me i utilize it, I just think its a real dick move of Intel to build what they call a "Server Board" and the processor design supports vt-d and they do not allow the function to work.

to me if i am paying for a "Server" product i should get server functions.
 
dasaint said:
The systems i have are running in my sig - Viper node using the antec ISK110 case, its SMALL/Quiet/Portable..
Click to expand...


That looks a better bet. So which is the best ITX motherboard to put in it?
 
Last edited:
As an Amazon Associate, HardForum may earn from qualifying purchases.
MicroATX is the way to go.

It is still small, you get a ton more expansion options, and it really is the same price if not cheaper.
 
I am personally going mATX as well the minis are AWESOME they are however limited that Intel board 2 posts up i have heard good things.

The H67s has the Nic issues i mentioned earlier
 
Seems like simple enough requirements. Small. mini-ITX. 16Gb. Dual Intel NICs. 1GB hard disk. ESXi support. Quiet.

I have one just like that running under my desk. Intel DQ77KB thin mini-ITX, I5-3470T. 16Gb SO-DIMM. Dual Intel-NICs with Intel vPRO/AMT remote management capability (to run completely headless). 128Gb Mushkin mSATA boot. 500GB SSD for VMs, etc (could easily have been a 1GB laptop drive). Akasa Euler heatsink case.

Supports VT-d. I did a USB passthrough in order to support running a Win-7 VM as a print server. There are some compromises with doing this (bugs in ESXi 5.1 passthrough support and weak support in general for USB3 controllers in ESXi).

Fanless. Not a single moving part in my version. Dead quiet.

Currently running windows server 2008 instance with a small web server and mail server (hMailserver), Win-7 VM running Blue Iris NVR (IP Security Cameras), freepbx on Centos and MythTV backend on Fedora. Its pushing the limits on the I5-3470T to keep up with the cameras and MythTV due to video processing load - but its really just filling a void while I am working out some more permanent things out in the garage.

Empty case:
IMG_4692a.jpg


With MB installed (bottom view, HD mounts inside top of case, under MB):
IMG_4693a.jpg


Mounted hiding under desk:
IMG_4726a.jpg
 
Last edited:
As a virtualization host its just providing a bridge while I rebuild/restack the "real" hosts in the garage. I'm likely going to move away from ESXi to Proxmox/KVM when I move back because the visualization hosts each have 48GB of memory and I don't want to pay license fees to VMware for a home/lab/playpen system (yes - hosts plural - as in one of the C6100 nodes discussed in another thread).

Not to worry, though. The silent under-the-desk build will get a new life as an XBMC/MythTV-based set top box when its virtual life comes to an end.
 
PigLover said:
As a virtualization host its just providing a bridge while I rebuild/restack the "real" hosts in the garage. I'm likely going to move away from ESXi to Proxmox/KVM when I move back because the visualization hosts each have 48GB of memory and I don't want to pay license fees to VMware for a home/lab/playpen system (yes - hosts plural - as in one of the C6100 nodes discussed in another thread).

Not to worry, though. The silent under-the-desk build will get a new life as an XBMC/MythTV-based set top box when its virtual life comes to an end.
Click to expand...

PL - I'm working on Proxmox VE also for the home lab since the colo is running it. Also planning on installing a few other cloud solutions.

C6100's are awesome. 4 thus far (3 in colo) and possibly 1 more en-route :-P
 
PigLover said:
As a virtualization host its just providing a bridge while I rebuild/restack the "real" hosts in the garage. I'm likely going to move away from ESXi to Proxmox/KVM when I move back because the visualization hosts each have 48GB of memory and I don't want to pay license fees to VMware for a home/lab/playpen system (yes - hosts plural - as in one of the C6100 nodes discussed in another thread).

Not to worry, though. The silent under-the-desk build will get a new life as an XBMC/MythTV-based set top box when its virtual life comes to an end.
Click to expand...

what is your result on proxmox

I had been toyed with proxmod last year. the product was OK and free (Open source).
was thinking to move my old esxi box ehem.. 4.X, but still on hold due on busy life.

any easy way to convert esxi image to proxmox without going through alot of pains..?


pjkenned said:
PL - I'm working on Proxmox VE also for the home lab since the colo is running it. Also planning on installing a few other cloud solutions.

C6100's are awesome. 4 thus far (3 in colo) and possibly 1 more en-route :-P
Click to expand...
wow. interesting, do you have some hints on proxmox? I just barely touched proxmox :D
 
Yea Piglover, its easier for me on the licensing since I work @ VMware, licenses aren't an issue for my configs...
 
Haven't started configuring the Proxmox based system(s) yet. That's a project that will probably start this weekend, though I'm not sure I'll get much past the rack, stack and cable part before I run out of time.

As for VMWare licenses - I think I could probably get access to those if I pushed it as the company I work for is one of VMWare's top customers worldwide and the project I am working is to open a whole new industry group to a virtualized deployment...but I'd probably be crossing a line I don't want to cross by asking. I like my job and am VERY interested in keeping it :)
 
PigLover said:
Haven't started configuring the Proxmox based system(s) yet. That's a project that will probably start this weekend, though I'm not sure I'll get much past the rack, stack and cable part before I run out of time.

As for VMWare licenses - I think I could probably get access to those if I pushed it as the company I work for is one of VMWare's top customers worldwide and the project I am working is to open a whole new industry group to a virtualized deployment...but I'd probably be crossing a line I don't want to cross by asking. I like my job and am VERY interested in keeping it :)
Click to expand...

I'm building a mini cloud lab to do just this. More on Proxmox VE soon.
 
Shuttle DS61. It is tiny, takes 1 SFF drive, has dual NICs, and a newegg review states it works with ESXi out of the box.
 
cptbjorn said:
Shuttle DS61. It is tiny, takes 1 SFF drive, has dual NICs, and a newegg review states it works with ESXi out of the box.
Click to expand...

This barebone system has a Realtek RTL8111E NIC.

I am not sure about ESXi 5.x but Realtek NIC reliability has not
been great when it comes to ESXi - if you get it to work at all.
 
Just built one today using the iStar S21 + Intel S1200KPR.
Heres the post w/ the pics
 
Realtek Nics might work in ESXi however i have had throughput issues on the card havent been able to saturate the 1GB part of that nic only got 35MB Writes and 70MB Reads max with a VM where as my Intel hosts were getting upper 90's MB Read and Write
 
dasaint said:
Realtek Nics might work in ESXi however i have had throughput issues on the card havent been able to saturate the 1GB part of that nic only got 35MB Writes and 70MB Reads max with a VM where as my Intel hosts were getting upper 90's MB Read and Write
Click to expand...

Realtek NIC should work on ESXi. the issue is its performance not good.

I would pick Intel or Broadcom NIC....
 
You must log in or register to reply here.
Back
Top