Immersion Cooling - anyone using it at work / non play use?

dbwillis

[H]F Junkie
Joined
Jul 9, 2002
Messages
9,350
Due to some urgent projects that need to get done, and AC upgrades being delayed due to parts (meaning our equipment rooms are a no go since the cooling cant support the new projects).....management went on and bought 2 full kits of immersion cooling.
Just arrived Monday on the freight truck, havent unboxed them yet.
Believe they went with GRC 'IceRaq' https://www.grcooling.com/iceraq/
 

Attachments

  • 20220922_122602.jpg
    20220922_122602.jpg
    445.1 KB · Views: 0
  • 20220922_122622.jpg
    20220922_122622.jpg
    339.3 KB · Views: 0
  • 20220923_111550.jpg
    20220923_111550.jpg
    437.2 KB · Views: 1
Vendor was finishing up the hardware stuff today.
2 units installed, 22U each side/42U per unit
Space for switches in the front dry area, close to your belly lol
Space for mounting PDU on the opposite side of the server space (also dry area)
 

Attachments

  • PXL_20230308_191819292.jpg
    PXL_20230308_191819292.jpg
    241.4 KB · Views: 0
  • PXL_20230308_191824553.jpg
    PXL_20230308_191824553.jpg
    330.6 KB · Views: 0
  • PXL_20230308_192209615.jpg
    PXL_20230308_192209615.jpg
    179.8 KB · Views: 0
  • PXL_20230308_192214645.jpg
    PXL_20230308_192214645.jpg
    244.4 KB · Views: 0
Seems like a bad idea in a lot of ways, but to be honest, I wouldn't be surprised if management secretly thought it'd be really cool to do this and went for it anyways.
It's just not a very practical solution, and even if it works, it doesn't seem like it'd be cheap either. But nonetheless, I still approve and would love to see what sort of temps and performance you get.
Do you think it's providing more performance than just air?
 
I want to build a thermoelectric immersion system. But water blocks seen superior for most scales of systems.

It would be easy/feasible to do a GPU or fpga cluster. But most of my need for systems like that is mining and for that the cheapest and simplist prevails.
 
Seems like a bad idea in a lot of ways, but to be honest, I wouldn't be surprised if management secretly thought it'd be really cool to do this and went for it anyways.
It's just not a very practical solution, and even if it works, it doesn't seem like it'd be cheap either. But nonetheless, I still approve and would love to see what sort of temps and performance you get.
Do you think it's providing more performance than just air?
If you design the system and order at an appropriate scale a server cluster cooled like this is efficiant enough. The problem is the custom racks and really why do you need coolin like that. Server cpus have a very comfertable thermal envolope on air and few accelerators can really utilize the improved cooling. Maybe If you were in a area chilled water was abundant and preferred
 
We plan to put our render farm workers in the'tubs'
Tech doing the install says HP now has PSU where you can disable the fans, as well as onboard fans that can be disabled.
Servers mount face down in the tubs, cabling at the top
He says GPU cards take very well to immersion cooling and that AMD CPU are hotter around the edges, where Intel CPU are hotter in the middle.
Amd take better to immersion cooling
 
Last edited:
Tuesday is the day, vendor is coming on site to help with the initial server installs and coolant fill.
 
Double the pleasure... That's only a pic of 1 container, there's another to the left of the grey door behind the one in the pic
 
1 unit filled with fluid, 2 servers installed and running, no network switches yet.
 

Attachments

  • PXL_20231003_184734939.jpg
    PXL_20231003_184734939.jpg
    286.3 KB · Views: 0
  • PXL_20231003_184805490.jpg
    PXL_20231003_184805490.jpg
    257.1 KB · Views: 0
Back
Top