Your home ESX server lab hardware specs?

Discussion in 'Virtualized Computing' started by agrikk, Dec 18, 2008.

  1. Outlaw85

    Outlaw85 Gawd

    Messages:
    532
    Joined:
    Feb 7, 2012
    Exactly. Something I can manage :)
     
  2. burritoincognito

    burritoincognito Gawd

    Messages:
    716
    Joined:
    Sep 17, 2012
    Just upgraded from a NUC i5 1.2GHz w/ 12GB RAM, 256GB SSD + 1TB data to a Dell PowerEdge T320 from work. Xeon 1.9GHz hex core w/ 96GB RAM, 3x256GB SSD & 3x1TB 7200 RAID 5 arrays.

    Kind of makes my laptop less necessary...I can go back to nesting things on a server instead of carrying around my lab and not using it.

    Although, whenever I get a proper license, I'll likely go back to a few NUCs and a NAS. But, for now, this will suffice. Especially with the price.
     
  3. trick0502

    trick0502 [H]ardness Supreme

    Messages:
    4,985
    Joined:
    Apr 17, 2006
    So I got an ibm x3550 m3 from work. I'm not sure if it's dual 8 thread or dual 12 thread, but it will have 192gb of ram. I only have three hdd cages right now, so I'll need to order more. I play on running a 240gb ssd and two 1tb reds in raid 1 for now. Should have it up and running over the weekend.

    Anyone have any know how if running esxi 6.5 on one of these?
     
  4. QHalo

    QHalo 2[H]4U

    Messages:
    3,434
    Joined:
    Sep 30, 2002
  5. TeleFragger

    TeleFragger Gawd

    Messages:
    598
    Joined:
    Nov 10, 2005
    ughhh I have been so busy.. everything is powered off and I haven't been on forums or anything.. so my bad.. bigtime.. 8 months late!!!



    that is the one I followed...
     
    ButlerKevinD likes this.
  6. Outlaw85

    Outlaw85 Gawd

    Messages:
    532
    Joined:
    Feb 7, 2012
    Since I did some cleanup. Thought I would share the progress.

    Was able to keep the front door but had to remove the rear.
    [​IMG]

    Sorry for flash reflection, didn't realize it was there until I uploaded.
    [​IMG]

    Going to try color coding cables. Made the purple ones for management. Black is standard network use for now.
    [​IMG]
     
    AltTabbins, gigatexal and Vengance_01 like this.
  7. AliceCooper

    AliceCooper [H]ard|Gawd

    Messages:
    1,458
    Joined:
    Mar 25, 2007
    Updated my lab this year.

    Dell R720 - ESXi 5.5 - File Server, pfsense, linux box, miner
    Dual Intel Xeon E5-2650L V2 10c/20T 1.7ghz
    192GB DDR3 ECC
    400GB Intel Enterprise SSD for the VM's
    Two 1TB Barracudas (storage)

    Dell R620 - ESXi 5.5 - Miner
    Dual E5-2667 6c/12T 2.9ghz
    64GB DDR3 ECC
    250GB 5400RPM 2.5" VM drive

    Dell R620 - ESXi 5.5 - Miner
    Dual E5-2620 6c/12T 2.0ghz
    32GB DDR3 ECC
    320GB 5400rpm 2.5" VM drive
     
  8. gigatexal

    gigatexal [H]ardness Supreme

    Messages:
    7,287
    Joined:
    Jun 22, 2004
  9. Outlaw85

    Outlaw85 Gawd

    Messages:
    532
    Joined:
    Feb 7, 2012
    No pics? where's the HW pron?!

    I do too on the san and in raid.
     
  10. AliceCooper

    AliceCooper [H]ard|Gawd

    Messages:
    1,458
    Joined:
    Mar 25, 2007
    Laptop spindles at that LOL. They're non critical VM's, could care less about their boot time or performance, this is my home lab and all they're going to do is run miners for now.


    Pic maybe to come lol, the cable management is horrendous. Hardly get a down time to work on it since my wife is home when I'm home and everything runs through the internet. Guess I could clean it up and move the server 1 PSU at a time. I'll take some tonight and if I remember I'll post em lol.

    Found this on my phone, maybe it will hold you over until the HW pics come lol. This is my R720.
    20170318_113417.jpg
     
    Last edited: Oct 5, 2017
    Outlaw85 likes this.
  11. AliceCooper

    AliceCooper [H]ard|Gawd

    Messages:
    1,458
    Joined:
    Mar 25, 2007
    Here you go :). Dont mind the cables lol.
     

    Attached Files:

    Outlaw85 likes this.
  12. Child of Wonder

    Child of Wonder 2[H]4U

    Messages:
    3,257
    Joined:
    May 22, 2006
    Updated my lab with a Pure m20 with 10TB raw.

    3.6:1 with about a dozen various VMs on it.
     
  13. mstrzyze

    mstrzyze n00bie

    Messages:
    3
    Joined:
    Dec 13, 2015
    Pics of that pure?;)
     
  14. agrikk

    agrikk Gawd

    Messages:
    927
    Joined:
    Apr 16, 2002
    I posted pics in the Network pics thread, but I finally got my ESX lab up and running around a much more performant iSCSI SAN.

    ESX1
    ESX2
    ESX3

    ESX 5.1
    Supermicro H8SGL-F motherboard
    Opteron 6128 8 cores @ 2 GHz
    32GB PC1333 RAM
    Mellanox ConnectX 10g HBA

    switch
    Fujitsu XG2000 10Gig switch

    SAN1 (iSCSI SAN)
    FreeNAS 11.1u1
    Supermicro X8DTE-F motherboard
    2x Xeon E5620 4 cores @ 2.4GHz each
    48GB Registered ECC PC1333 RAM
    IBM M1015 HBA (Flashed to LSI 9240-IT mode)
    8x 256GB Samsung EVO 850 SSD
    Mellanox ConnectX 10gig HBA

    I am able to generate 150,000 read IO/s sustained with a combined non-sequential read/write load of 40,000.

    Finding the combination of firmware and drivers and OSes that would make the ConnectX cards work together (in either ethernet mode or Infiniband mode) was an absolute street fight but it all finally plays nicely together.

    If I were to do it over again, I would have gone with the ConnextX-3 SFP cards, but I would have had to use NexentaStor CE for my SAN and pay a premium for a managed Infiniband switch.
     
    TeleFragger likes this.
  15. jlbenedict

    jlbenedict [H]ard|Gawd

    Messages:
    1,119
    Joined:
    May 22, 2005
    Should be posting here in a few days, but.. the lab will be just about finished up (LOL that's what they all say).

    Not as elaborate as a full rack, but it will be simple and get the job done.
    Two DL380 G6's [ Dual L5630's + 64gb + few local WD VelociRaptors ]
    Netgear RR2304 4-bay 1u NAS
    TP-Link gigabit switch of some sort .. will have a more detailed post once all wired up
     
  16. ChRoNo16

    ChRoNo16 [H]ard|Gawd

    Messages:
    1,207
    Joined:
    Feb 3, 2011

    Detailed with pictures would be nice. I am running a single server like yours, its not bad, but man I hate myself for picking the 2.5 SAS model
     
  17. Orddie

    Orddie 2[H]4U

    Messages:
    2,135
    Joined:
    Dec 20, 2010
    I love the 2.5 SAS. more drives per RU. what issues / concerns are you having?
     
  18. ChRoNo16

    ChRoNo16 [H]ard|Gawd

    Messages:
    1,207
    Joined:
    Feb 3, 2011
    For one, No, because this only has cage for 8 2.5 sas drives. but my biggest issue is the cost of drives that size. to get 1tb sas drives in that size im looking at 200 bucks give or take per drive. where if it was a 3.5 setup, I could find drives under a hundred
     
    mrwizardno2 likes this.
  19. mrwizardno2

    mrwizardno2 Limp Gawd

    Messages:
    187
    Joined:
    Jan 20, 2012
    This is why I went with the DL380P G8 with 12 LFF drives! 3.5 drives are way cheaper!
     
  20. jlbenedict

    jlbenedict [H]ard|Gawd

    Messages:
    1,119
    Joined:
    May 22, 2005
    Looking back last year when I purchased my two DL380's... there is sometimes a little regret in not going with possibly the Dell R510's or R710 LFF.
     
  21. jlbenedict

    jlbenedict [H]ard|Gawd

    Messages:
    1,119
    Joined:
    May 22, 2005
    Camera phone picture... not the best quality.. need to tidy up and dust the top off.. TP-Link switch got removed and I ended up scoring a Netgear GS748t v5 :) Sweet.. hopefully it works out , and is a decent switch. Traded my old dual 771 beast away for it. The little 2u Rosewill server ; no use as of yet... it has an ASrock QC5000m board in it, A4-4000 quad core, 2gb or ram.. not hooked up.. just filling space currently. Might make it a physical domain controller, once I get the lab rolling..


    IMG_20180324_152710.jpg
     
    Outlaw85 likes this.
  22. ChRoNo16

    ChRoNo16 [H]ard|Gawd

    Messages:
    1,207
    Joined:
    Feb 3, 2011
    Looks like you have plenty of gear, whats keeping you from getting that lab going?
     
  23. jlbenedict

    jlbenedict [H]ard|Gawd

    Messages:
    1,119
    Joined:
    May 22, 2005
    Time lol

    Plus, a few months back, I had some drives crap out, so I've been down for a bit.
    Ready to fire up everything from scratch , again.
     
  24. ChRoNo16

    ChRoNo16 [H]ard|Gawd

    Messages:
    1,207
    Joined:
    Feb 3, 2011
    Depends on your needs. If you just want to run one as a lab, 146gb sas drives are cheap. if your patient 300's are as well.

    Im at a loss I dont know what Im going to do right now. I need faster speed than im getting out of 10k drives. 3-4 vm's per disk and its crawling.

    Could go SSD's but then I lose storage space so idk
     
  25. beyonddc

    beyonddc Limp Gawd

    Messages:
    372
    Joined:
    Sep 25, 2002
    Just started my journey to the ESXI world. I have been using Virtual Box on my desktop for years and recently build a new PC so I have a spare PC for dedicated VM hosting.

    My ESXI server spec is as follow:
    CPU: i7 2600k
    RAM: 32GB
    HDD1: 500GB
    HDD2: 3TB

    Just started playing with the configuration and very happy to see that it has an option to see all VLANs traffic. I have an EdgeRouter X at home so now I can host VMs and can be reside in multiple VLANs. :)
     
  26. thecold

    thecold [H]Lite

    Messages:
    105
    Joined:
    Nov 12, 2017
    I use mine as a lab machine with some minor internal server hosting on the side. It's my old desktop, so besides the p3700 I already had all of it.

    CPU: I 74930k
    Ram: 48 GB @ 1600
    Motherboard: x79ws
    ssd1: 500 gig mx 200
    ssd2: 1.6tb intel p3700
    Graphics card: r9 fury - because I didn't have another one hanging around when I built it. It'll be changed soon enough, lol.
     
  27. repoman0

    repoman0 Gawd

    Messages:
    988
    Joined:
    Apr 7, 2006
    Supermicro 826 SAS3 (12 bay 2U) chassis with:

    - Single socket basic X10 board
    - Quad core Xeon E5 v3 (Haswell)
    - 16 GB ECC DDR4
    - 2x128GB SSD
    - 2x4TB WD Gold
    - quad gigabit PCI-E Intel ethernet

    Pretty basic compared to most here but it does everything I'm asking of it, which is basically run Proxmox serving a 4TB mirrored ZFS volume and run a pfsense router VM. There's other stuff I'll play around with eventually but for now I'm just enjoying having real network storage and a good router.
     
  28. TordanGow

    TordanGow Limp Gawd

    Messages:
    206
    Joined:
    May 25, 2015
    ESXI1 - running off a flash drive:
    I5-2400S
    Some random cheap MSI Motherboard
    24 GB DDR3-1600
    1x256 GB SSD, 1x1TB Samsung F3 Hd, 1x3TB Hitachi Ultrastar 7K4000
    2 port Intel NIC

    ESXI2 - running off a flash drive:
    I3-2100
    Some random cheap Gigabyte Motherboard
    16 GB DDR3-1333
    1x120 GB SSD, 1x3TB Hitachi Ultrastar 7K4000
    2 port Intel NIC

    The servers also have access to my NAS via iSCSI


    All VM Run as single function appliances:
    • R Studio Server ( https://www.rstudio.com/products/rstudio/ )
    • MYSQL Server
    • Bind DNS Resolver #1
    • Bind DNS Resolver #2
    • Ubiquiti UniFi
    • Sickbeard
    • Minecraft OS
    • OpenVPN
    • Apache/PHP webhost
    • Owncloud Calendar service
    • ZoneMinder Security Camera PVR
    • FreePBX
    • SmokePing
     
  29. TeleFragger

    TeleFragger Gawd

    Messages:
    598
    Joined:
    Nov 10, 2005
    I have been playing around with a Lenovo D30. Dual Xeon (forget cpu at the moment) and just put 128gb ram in it.
    From "My" experience. even at work... I run out of memory before cpu so the dual xeon works great. On drives, I do not have raid setup at all. Just single sata drives setup and I have them as default...
    datastore1, datastore2, etc. I then balance my vms across them and it seems that I never really see any performance issues.
    Ill fire it up later and try to take a pic or 2
     
  30. TeleFragger

    TeleFragger Gawd

    Messages:
    598
    Joined:
    Nov 10, 2005
    just tried googling this and not finding anything. What is this??? looks interesting...
     
  31. TordanGow

    TordanGow Limp Gawd

    Messages:
    206
    Joined:
    May 25, 2015
    TeleFragger likes this.
  32. TeleFragger

    TeleFragger Gawd

    Messages:
    598
    Joined:
    Nov 10, 2005
  33. ironforge

    ironforge [H]ard|Gawd

    Messages:
    1,139
    Joined:
    Feb 7, 2006
    Here is my basic setup.

    Supermicro X9DRI-F motherboard
    Dual Xeon E5-2643
    32GB ECC memory
    Samsung 850 PRO 256gb boot/vm drive
    2 x WD RED 4TB data drives

    running esxi 6.5 free edition

    VM's
    Ubuntu Plex server
    Sophos UTM
    Windows 10 pro (for testing)
    Window server 2012R2 - IP camera / fileshare / handbrake encoding for plex
     
  34. TeleFragger

    TeleFragger Gawd

    Messages:
    598
    Joined:
    Nov 10, 2005
    I never went to 6.5 because i couldnt find the free edition. I gotta look again.
     
  35. ironforge

    ironforge [H]ard|Gawd

    Messages:
    1,139
    Joined:
    Feb 7, 2006
  36. tacos4me

    tacos4me Gawd

    Messages:
    737
    Joined:
    Apr 5, 2006
    Older pic, missing some drives, but here's my little home lab. Excuse the dust. The oldschool C2100 isn't doing any crunching anymore, but the 1U rig is my home test-bed + media server + NVR, on ESXI 6.5 right now. 136TB of raw disk here.

    House has 1000/1000 GPON, from same provider I use at work for our colo. So that's convenient (I work from home a lot).

    Dell X1052P (picked this up open box on eBay for $200, score. And yes, I know this belongs on the other side of the rack. I like to look at the blinky lights though, sorry.)

    RS500-E8-PS4
    2x E5-2640 V4
    128GB DDR4
    4x 10TB IronWolf Pro

    Dell C2100
    This thing is due to be replaced w/ a JBOD enclosure
    12x 8TB WD Red (thanks Best Buy)

    Corsair case is my old X99 rig, she gone. Sold to a member here actually.
    What a PITA keeping that case in a rack. Not doing that again, heh.

    Emotiva XDA-2
    2x Emotiva XPA-100

    QnIb1qy.png
     
    TeleFragger and jlbenedict like this.