G34 4P Supermicro Pics

Discussion in 'Distributed Computing' started by Linden, Jan 15, 2012.

  1. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
    Introducing "Greyhound 5"

    Supermicro H8QGL-iF
    4 X Opteron 6136 2.4 @ 2.7GHz
    64GB G.Skill DDR3 1600
    Corsair AX750
    4 X Cooler Master Hyper 212+
    Rocketfish/Lian Li modified for SWTX format and w/window
    Linux, Ubuntu 10.10

    View through Rocketfish side panel window:
    [​IMG]

    View with side panel removed:
    [​IMG]

    Closeup view:
    [​IMG]
     
    Last edited: Jan 15, 2012
  2. colinstu

    colinstu 2[H]4U

    Messages:
    3,567
    Joined:
    Oct 11, 2007
  3. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
  4. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
    A big, big thank you to all [H]orde Folders who helped me along the way in building and optimizing this rig. It's folding full time.
     
  5. Tobit

    Tobit [H]ard|DCer of the Month - March 2010/May 2011

    Messages:
    5,059
    Joined:
    Dec 12, 2005
    Nicely done my friend.
     
  6. brycejones

    brycejones [H]ardness Supreme

    Messages:
    5,978
    Joined:
    Jan 29, 2002
    very nice,very clean, very well done.
     
  7. dreadwing

    dreadwing [H]ard|DCer of the Month - March 2012

    Messages:
    207
    Joined:
    Sep 8, 2011
    Awesome case! What mods if any were required to fit the 4P system?
     
  8. chaandan

    chaandan Limp Gawd

    Messages:
    256
    Joined:
    Jun 3, 2011
    that is one clean system. :) and perfect lighting !!
     
  9. DSee

    DSee 2[H]4U

    Messages:
    2,101
    Joined:
    Aug 31, 2007
    Beautiful system...
    Good job on the PSU mounting.
     
  10. sbinh

    sbinh Gawd

    Messages:
    736
    Joined:
    Jul 12, 2008
    Love the rocketfish case .... plenty of space ..
     
  11. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
    Case mods to fit SWTX:

    • drilled holes in motherboard tray for SWTX pattern; did not tap, just secured standoffs with matching nuts
    • relocated rear 120mm case fan to exterior
    • cut out part of the top expansion port bracket (to clear motherboard LAN ports)
    Other mods for personal aesthetics and cooling:


    • cut out 18 square inches of aluminum from the rear, drilled, and added 2 X 80mm exhaust fans above the 120mm rear exhaust
    • Installed 2 X 120mm intake fans in main 3.5" drive compartment
    • cut out perforated vent beneath the PSU
    • installed a couple low-Wattage fluorescent lights (one on the case ceiling and one just under front drive cage)
     
    Last edited: Jan 15, 2012
  12. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
    Another closeup, this one with more of an industrial "big iron" look :D

    [​IMG]
     
  13. vsboxerboy

    vsboxerboy 2[H]4U

    Messages:
    3,696
    Joined:
    Oct 17, 2005
  14. Kendrak

    Kendrak [H]ard|DCer of the Year 2009

    Messages:
    22,871
    Joined:
    Aug 29, 2001
    This is the "good" twin to my G34, 4P.
     
  15. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
    Honored to be related! Separated at birth, no doubt.
     
  16. Untitledone

    Untitledone [H]ard|DCer of the Month - April 2012

    Messages:
    1,500
    Joined:
    Feb 28, 2011
    Be careful not to choke those chokes underneath the musky mod crossbar. Make sure it gets some air flow.
     
  17. R-Type

    R-Type [H]ard|DCer of the Month - October 2011

    Messages:
    2,531
    Joined:
    Mar 6, 2006
    This is a good looking build, made all the more so by the fact most of its siblings around here run naked.

    Its like a guy wearing a suit in the middle of burning man...
     
  18. Kendrak

    Kendrak [H]ard|DCer of the Year 2009

    Messages:
    22,871
    Joined:
    Aug 29, 2001
    My 4P doesn't even have a burlap sack, just a wedge of cardboard it sits on.
     
  19. grumpy_rock

    grumpy_rock Limp Gawd

    Messages:
    167
    Joined:
    Sep 7, 2010
    I just printed out the close up picture and taped it to the window on the side of my case.... at least I can pretend.
     
  20. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
    Airflow to the motherboard components - good advice. There's actually more air flow over the board parts than before, when the system was caseless. What you don't see in the pictures is three 120mm fans in the front blowing across the board. Also, there's actually quite a bit of clearance between the heatsink retention bars and the components underneath.

    The system is running on my garage workbench. It took up too much space in a horizontal configuration, sans clothing, and I was also concerned I might damage it when working on other projects on the bench. I had the Rocketfish down in the walk-space packaged up; it came out of retirement for a great second career.
     
  21. Linden

    Linden [H]ard|Gawd

    Messages:
    1,140
    Joined:
    Sep 8, 2005
    Hey, just add a big air foil (wing) at the back, top of the case, and you'll be set!

    I'm honored. I've been Folding since right after the Folding@Home started, and this is my first really big adventure.
     
  22. rvborgh

    rvborgh [H]Lite

    Messages:
    74
    Joined:
    Jul 1, 2014
    Thought i'd bump this thread with photos of my project 4P G34 home system (its been running flawlessly for over a year now).

    [​IMG]

    [​IMG]

    [​IMG]
     
  23. [Ion]

    [Ion] [H]ard|Gawd

    Messages:
    1,060
    Joined:
    Jun 2, 2009
    Very professional looking setup!
    Where'd you find the case? I'm looking for something quieter than my 1U case but more secure than just taking off the top and mounting tower heatsinks.
     
  24. ChelseaOilman

    ChelseaOilman [H]ard|Gawd

    Messages:
    1,231
    Joined:
    Mar 27, 2001
  25. mmonnin

    mmonnin [H]Lite

    Messages:
    100
    Joined:
    Jan 11, 2004
    I thought those looked like hot swap fans. And fans not meant to be sitting on a desktop either. Yikes.
     
  26. rvborgh

    rvborgh [H]Lite

    Messages:
    74
    Joined:
    Jul 1, 2014
    if you ran the rear fans at full speed you would be right (see photo below... they run around 2050-2100 rpms). Case temps usually run around 82F. 91F at the hottest... but this thing doesn't run at full bore or even close to it.

    i use a fan controller and run those rear fans more slowly... there is an "elbow" point in the rpm speed after which they become loud... i run them just below this elbow point. i also added an additional SuperMicro fan kit normally used for the GPU units so i had 4 fans instead of the original 3... this also lets me run them all slower for the same airflow.

    i also upgraded the dual 1000w removeable PSU to more efficient 1400w ones... with the variable duty cycle 25mm fans... so they are barely making any noise either. To help them out i also installed additional Noctua 92mm fan right where they exhaust to pull hot air into the main motherboard area (unfortunately the above photos taken before i did this).

    EDIT: i forgot to add that i also removed the backplane on the unused SCSI drive as well as the drive holders... this gives a straight shot through improving airflow through the case and was good for about 5C or so in case temps.

    its perfectly fine for home desktop use now and it sits right behind my monitor :)

    [​IMG]

     
    Last edited: Jan 18, 2016
  27. plext0r

    plext0r [H]ard DCOTM x3

    Messages:
    778
    Joined:
    Dec 1, 2009
    Nice job modding that 4U SuperMicro case. I've done similar with the 4P E5-4650 setup. The cases are beasts; luckily mine are rack-mounted and I don't have to listen to them.
     
  28. mi7chy

    mi7chy 2[H]4U

    Messages:
    3,987
    Joined:
    May 22, 2013
    Nice except on mine I was bothered by the disrupting up down CPU cooler air flow so I jerry rigged it to make it front back.
     
  29. rvborgh

    rvborgh [H]Lite

    Messages:
    74
    Joined:
    Jul 1, 2014
    Thanks :) i ran across it new at an Ebay auction for $80 (seller mislabeled it or didn't know what they were selling)... not knowing how loud it would be. i just had to have it. Didn't want a boat anchor so ended up spending about $300 quieting it down. So in a way i didn't have much of a choice :) Once i had it i was stuck :) Its a tank at 80 lbs or so.

    i'd like to water cool it one of these days, and take it down to the machine shop and have a side window cut out for it.

     
  30. Skillz

    Skillz [H]ard DCOTM Jan,2016

    Messages:
    15,846
    Joined:
    Aug 14, 2004
    I looked up that case. Holy mother of God is it expensive.
     
  31. ChelseaOilman

    ChelseaOilman [H]ard|Gawd

    Messages:
    1,231
    Joined:
    Mar 27, 2001
    Partly because in the case of the link I gave it comes with redundant 1,400 watt PSUs. ;)
     
  32. Skillz

    Skillz [H]ard DCOTM Jan,2016

    Messages:
    15,846
    Joined:
    Aug 14, 2004
    So about $500 in PSU's give or take $100. Still does't explain the other $500+. :p
     
  33. ChelseaOilman

    ChelseaOilman [H]ard|Gawd

    Messages:
    1,231
    Joined:
    Mar 27, 2001
    Last edited: Jan 19, 2016
  34. Skillz

    Skillz [H]ard DCOTM Jan,2016

    Messages:
    15,846
    Joined:
    Aug 14, 2004
    I'd rather use cardboard. lol
     
  35. [Ion]

    [Ion] [H]ard|Gawd

    Messages:
    1,060
    Joined:
    Jun 2, 2009
    I'll get pics of some of my systems later this week--I have a 32c 4P setup in a Spootswood case, a 48c 4P setup in a Spootswood case, and a 1U 64c setup. Also have parts on the way for 2 more 1U 48c setups :)
     
  36. Jurriaan

    Jurriaan n00bie

    Messages:
    7
    Joined:
    Feb 14, 2016
    I have scored (at 800$, more of a steal, i think) myself one of those as well:

    - Supermicro H8QG6-F
    - 4x 6274 with passive coolers
    - Supermicro SC748 chassis w/2 redudant 1400W powersupplies
    - 16 dimms x 8 Gb each

    and I must say: the loudness overrides the nice points. Boinc is chugging along nicely, running 16 MCM1 tasks @ about 5 hours 30 minutes each. That is the same time as a dual X5650 Xeon system. It won't download more tasks at the moment, both CEP2 and UGM1 complain about 'transient HTTP errors'.

    Do I read correctly that better CPU coolers (Noctua NH-9UD0) and a fan-controller on the existing fans are enough to bring the noiselevel down? Did you do anything with the fans behind the drivecage inside? This system will move to my office, so it needn't be absolutlely silent, but right now even the bios option Balanced gives a lot of noise.
     
  37. Gilthanis

    Gilthanis [H]ard|DCer of the Year - 2014

    Messages:
    5,409
    Joined:
    Jan 29, 2006
    Jurriaan, are you behind a proxy by chance?

    If so, you may need to create a cc_config.xml file.

    <cc_config>
    <options>
    <use_all_gpus>1</use_all_gpus>
    <http_1_0>1</http_1_0>
    <report_results_immediately>1</report_results_immediately>
    </options>
    </cc_config>
     
  38. Jurriaan

    Jurriaan n00bie

    Messages:
    7
    Joined:
    Feb 14, 2016
    Unfortunately, no. I'm behind a router - another PC on that same router has no problems and I don't think there's anything wrong with the network on the Opteron system, since a Debian netinstall went fine.
     
  39. Jurriaan

    Jurriaan n00bie

    Messages:
    7
    Joined:
    Feb 14, 2016
    Unfortunately, no. I'm behind a router - another PC on that same router has no problems and I don't think there's anything wrong with the network on the Opteron system, since a Debian netinstall went fine.

    I think it's something else:

    Code:
    jurriaan@opteron:~$ wget [url]http://BDD7.https.cdn.softlayer.net/80BDD7/grid.worldcommunitygrid.org/boinc/download/slideshow/fahb_01_v01.gif[/url]
    --2016-02-14 21:12:30--  [url]http://bdd7.https.cdn.softlayer.net/80BDD7/grid.worldcommunitygrid.org/boinc/download/slideshow/fahb_01_v01.gif[/url]
    Resolving bdd7.https.cdn.softlayer.net (bdd7.https.cdn.softlayer.net)... 93.184.221.109
    Connecting to bdd7.https.cdn.softlayer.net (bdd7.https.cdn.softlayer.net)|93.184.221.109|:80... connected.
    HTTP request sent, awaiting response... 504 Gateway Timeout
    Retrying.
    
    --2016-02-14 21:12:31--  (try: 2)  [url]http://bdd7.https.cdn.softlayer.net/80BDD7/grid.worldcommunitygrid.org/boinc/download/slideshow/fahb_01_v01.gif[/url]
    Connecting to bdd7.https.cdn.softlayer.net (bdd7.https.cdn.softlayer.net)|93.184.221.109|:80... connected.
    HTTP request sent, awaiting response... 504 Gateway Timeout
    Retrying.
    
    --2016-02-14 21:12:33--  (try: 3)  [url]http://bdd7.https.cdn.softlayer.net/80BDD7/grid.worldcommunitygrid.org/boinc/download/slideshow/fahb_01_v01.gif[/url]
    Connecting to bdd7.https.cdn.softlayer.net (bdd7.https.cdn.softlayer.net)|93.184.221.109|:80... connected.
    HTTP request sent, awaiting response... 504 Gateway Timeout
    Retrying.
    
    --2016-02-14 21:12:37--  (try: 4)  [url]http://bdd7.https.cdn.softlayer.net/80BDD7/grid.worldcommunitygrid.org/boinc/download/slideshow/fahb_01_v01.gif[/url]
    Connecting to bdd7.https.cdn.softlayer.net (bdd7.https.cdn.softlayer.net)|93.184.221.109|:80... connected.
    HTTP request sent, awaiting response... 504 Gateway Timeout
    Retrying.
    
    However, I wouldn't like to steer this thread too much offtopic, I'm primarily interested in cooling and sound here!
     
  40. ChelseaOilman

    ChelseaOilman [H]ard|Gawd

    Messages:
    1,231
    Joined:
    Mar 27, 2001
    I use Dynatron A14 coolers on my server. They're only $30 at Directron. My server heats my house and the noise isn't bad. I replaced all the case fans with some 80mm Thermaltake fans I already had. They have fan controllers.
    http://www.directron.com/a14.html?gsear=1
    Most guys here use the Cooler Master 212+ heatsinks with the musky mod. They are very quiet but a real pain to mount in a server case.