• Some users have recently had their accounts hijacked. It seems that the now defunct EVGA forums might have compromised your password there and seems many are using the same PW here. We would suggest you UPDATE YOUR PASSWORD and TURN ON 2FA for your account here to further secure it. None of the compromised accounts had 2FA turned on.
    Once you have enabled 2FA, your account will be updated soon to show a badge, letting other members know that you use 2FA to protect your account. This should be beneficial for everyone that uses FSFT.

Aussie 4P opteron

T

terrabyte89

Weaksauce
2FA
Joined
Nov 6, 2004
Messages
120
Hi everyone! Thought I might share my new 4P opteron system with you guys! The only one (soon to be) folding for team 24 that I am aware of.

Wouldn't have been possible without the excellent guides here on Hardocp!

Specs:

4x 6164HE opteron G34 CPU's (12 core 1.7ghz low power)
Supermicro H8QGI-F board. (the one from ebay with the gateway bios for $500).
4x CM hyper 212+ coolers with the alternative mounting method (thanks Musky)
8 sticks of Corsair vengeance 2gb DDR3 1600. XMP compatible, will be 16 sticks once I get some more cash.
Coolermaster 932 case
Silverstone 1200W gold Evolution PSU


Here she is all up and running!



I ended up having to make my own brackets etc for the coolers. Musky's guide is excellent but unfortunately those parts are nearly impossible to come by down here :(. Even #6-32 thread screws are nearly impossible to find!



I drilled some more holes for some extra stand offs but up the top in the 932 there is basically nothing to attach them to. So cable ties to the rescue! (I needed some support for the top of the board as it's vertically mounted)








Thanks Musky for your excellent hsf mounting guide, and thanks to tear for all the work on the bios that I will soon be using :).


Now to get past all these stupid linux shitty problems!! You'd think a proxy with authentication wouldn't be such a big ask, but apparently it is!!
 
Great... let us know when you want to make the move to 33...:D
 
My eye is twitching...

YErQ4rL.png


Very cool build, did you post parts you used for mounting the 212's to the musky mount thread? it might help others that don't have access to musky's parts
 
bigted beat me to it. On the left two CPU's make sure the airflow is in the same direction for both.

otherwise- Congrats !
 
Just to let you know you can fit the 230mm fan that came with the case to the top outside of the case, this could give you some extra airflow.
 
Don't worry guys, here's how she looks today :). (Took that first pic yesterday)



I'm going to run into an issue with that top left fan though once I run 4 channels of ram. The corsair vengeance heatspreaders are ridiculously high.

Thanks for the tip spaz, I was thinking about that, I probably should have mounted it before I put the board in though haha. Fans held on with 2 screws now so it's not going anywhere.


She's just finished her 2nd frame on a P8101. Reporting a bit over 20 mins per frame and a tad under 190k ppd. Seems alright to me for stock chips and only 2 channels of ram per cpu. I expect it will up a little bit after she completes a few more frames.

I'm using lm-sensors to have a look at the temps but it's reporting 10 different temp sensors. 1&2 are constantly 128c, so I'll assume they're broken :p. 3&4 are 55-65c. and the last 6 are around 40c give or take. Does anyone know what sensors these actually map to?


Another random question for peeps please :). I've got a 2P E5-2620 xeon server. I know it's pretty weak, only 12 cores @ 2.0ghz so it won't run bigadv. But running a default fah7 client it shows just over 30k ppd. Is that all a 2P low end xeon e5 will do? Or am I missing something?
 
terrabyte89 said:
Another random question for peeps please :). I've got a 2P E5-2620 xeon server. I know it's pretty weak, only 12 cores @ 2.0ghz so it won't run bigadv. But running a default fah7 client it shows just over 30k ppd. Is that all a 2P low end xeon e5 will do? Or am I missing something?
Click to expand...

It sounds a bit low, a 2.4 ghz dual hex 1366 will get about 47k so something may be amiss.

Do you have turbo engaged, HT on and 4 dimms per cpu socket?
 
Thanks for the help guys! I'll look into those settings on ther 2p xeon.

The 4p completed her first work unit last night! Shes been given another P8101 and settled around 192k PPD after 25 frames. None of the temps are higer than 41c atm. I think I probably saw 43c yesterday. Not too bad, looks like I'll give the OC bios a shot this week coming. I've also got to order the last of the ram, try and get 4 channels going!
 
Picked up an 8105 core yesterday and she was doing 290k. Loaded the OC BIOS shortly afterwards. Running the memory slow and with lax timings just to see how the CPU's go. Booted with a 20% OC, no voltage changes, up to 2040mhz per core. Instant 50k ppd boost despite running the memory slow. Took her up to 345k on this wu. The OC bios runs the CPU fans at 100% so temps are ridiculously low, I'm talking low 30's at full load!

I think with 4 channels of ram, the memory speed brought back up and a little bit more of an OC 400k+ ppd should be easily achievable.

Thanks again Musky and Tear :)
 
Or blow some air on them. 6164 HEs don't use whole a lot of power, even if OCd.
 
Yeah I'm noticing they musn't be using much power, the full load temp tops out around 35c! The 1200w silverstone might have been a bit of overkill :p. Better too much than not enough though!!!

The 932 has a massive fan blowing on the board from the side, 120mm intake and exhaust as well as the big 230mm fan on the top. So hopefully enough airflow for the VRMs.

I didn't realise 4 channel ram made such a big difference! With no other changes, just adding 2 more sticks to each CPU PPD has jumped from ~350k to ~435k. With a bigger OC and higher ram speed/tighter timings, who knows, maybe 500k is achievable!!
 
You should aim for the PSU to be between 50-70% load so that PSU is good.

IIRC the 6100 series is heavily affected by ram speeds. Thats why most people use 1333Mhz Cas 7 or 1600Mhz Cas 8 (Or the rich people with 1600Mhz Cas 6)
 
Ah ok, that's why 4 channel made such a big difference.

Any idea how to check the actual current ram timings/speed in linux? tpc -dram only seems to show the rams default speeds.

Thanks :).
 
tpc -dram shows actual configuration from the memory controller.

Note that, when OCing, you need to manually recalculate memory clock
from tpc -dram.

For instance, if tpc is reporting DDR3-1066 and your refclock is 240, then
your effective DDR3 rate is something along DDR3-1280 (1066.66 * 240 / 200).
 
Ohh, I gotcha.

TPC -dram is listing my ram as 1066 CAS8.

I've bumped the refclock to 260

so 1066.66 * 260/200 = 1386 C8.

Being 1600 C9 memory it should be able to do this easily.


Bit of an idea can I change the default in the bios to 1333 memory and drop the refclock to say 250. So it should end up around 1666mhz DDR3 speeds? Might have to use the relaxed mem timings in ocng.

Thanks for your help :).
 
If you didn't enable "Allow effective frequencies > DDR3-1333" in advanced section of ocng-cu then
260 yielded probably 800 * 260 / 200. Check tpc -dram while at 260 to double check.

You'll need to enable said option to exceed effective DDR3-1333.

To yield DDR3-1600 even, you'll need to use refclock of 240 and enable the option I quoted above.
However, note that you will gain more performance by finding maximum possible refclock _regardless_
of memory frequency.

That is, if your CPUs can handle refclock 260, your system will fold faster than w/240 even though
memory speed is lower (sic!).

EDIT: also, OCNG will _not_ let you exceed rated memory frequency (unless you reflash the SPD);
     that said, 241 (w/DDR3-1333+ option enabled and DDR3-1600 DIMM) will drop the rate
     to DDR3-1285-ish (1066.66*241/200).
 
Last edited:
I already have allow effective memory frequencies above 1333 enabled :). Relax memory timings is also switched off.

Even at 260, tpc -dram is still listing the ram as DDR 1066 C8. The spd should definitely be 1600 C9 though? Even 1333 would be closer.

Thanks again for helping me out, been years since I've oc'ed anything and certainly nothing before on Linux! (warm fuzzies of my old A64 3000+ with a 54% OC :D)
 
She is currently showing 472k PPD :). 500k is so close but looks like I might have reached it's limits!
 
1066 * 260/200 = 1386, so you are over 1333. If the system were to set the memory at 1333, you would be trying to run your memory at 1733 actual. While that may be possible, it is not supported in the overclocking tool.
 
Ah ok, that makes sense. So it sounds like she's running fairly optimally then and at her OC'ing limit. Thanks for the help guys! :)
 
You must log in or register to reply here.
Back
Top