I have some problems with my new Xeon 4P rig, need some help?

A

-alias-

Limp Gawd
Joined
Jul 15, 2012
Messages
374
I have some problems with my new Xeon 4P rig. Mobo is SMX9QRi-F+ and 4 x E5 4650 ES C1 stepping QBEC, and they are all recognized and working perfect in socket1 and socket2. I have tried with 16 x 4G of this memory http://www.corsair.com/en/memory-by...annel-ddr3-memory-kit-cml16gx3m4a1600c9b.html and 16 x 1GB of this http://www.kingston.com/datasheets/KVR1333D3N9_1G.pdf but there is no change.

The problem is that it will not boot when all 4 CPUs are assembled. It booting ok with 1, 2, and 3 or 1,3 and 4. Only 1 and 2 are visable in bios. When it is not booting it ending allways with code 32 or AF

The SM mobo has not GBLAN outputs visible in Ubuntu 11.10. Ubuntu 11.10 was installed and is running just fine when 2 CPUs are assembled.

I have also tried with memory only on CPU1, with all CPUs assembled, no change there either. I have checked all the socket for damage, but they are all in perfect condition.

It looks to me like half of the mobo is disablet in a way.
 
could be some jumper settings that enable/disable CPU(s)????
 
Check BIOS settings for the board, it may disable some CPU sockets, I know there are some 4P boards out there where you can have it set to only work with 2P unless you tell the BIOS there are 4...... so check the BIOS settings or as sbinh, check for a jumper on the board.
 
Whats the exact manufacturer and model of the motherboard?
 
Also could be a power problem. Is there enough power in the PSU? Are all the cables supplying power connected?

Just a thought.
 
FrEaKy said:
Check BIOS settings for the board, it may disable some CPU sockets, I know there are some 4P boards out there where you can have it set to only work with 2P unless you tell the BIOS there are 4...... so check the BIOS settings or as sbinh, check for a jumper on the board.
Click to expand...

I can not find such settings on this board, but I will take another closer look, thanks.

rick5127 said:
Also could be a power problem. Is there enough power in the PSU? Are all the cables supplying power connected?

Just a thought.
Click to expand...

The PSU is a Corsair AX 1200W so it should make the job. I have connected all four 12V EPS on the board.
 
The board does have a specific BIOS section of CPU configuration. Make sure all sockets are enabled: see 4-7.
 
I would try testing all the CPU's by themselves to make sure it's not a bad CPU. It is also possible your running into some strange compatibility issue with the ES chips and the Supermicro board.
 
402blownstroker said:
The board does have a specific BIOS section of CPU configuration. Make sure all sockets are enabled: see 4-7.
Click to expand...

Thanks, I do that now and I will be back soon!

Edit: No under 4 - 7 one can read about:

Active Processor Cores
Set to Enabled to use a processor's second core and above. (Please refer to Intel's
website for more information.) The options are All, 1, 2, 4, 6.

tkam said:
I would try testing all the CPU's by themselves to make sure it's not a bad CPU. It is also possible your running into some strange compatibility issue with the ES chips and the Supermicro board.
Click to expand...

Did that, they are all working perfectly i socket1 and socket2. The ES compatibility issue could be a problem, maybe I should update the bios form 1.0 to 1.0A.
 
Last edited:
The mobo do not give me any error beeps, or no beep at all. Only codes is visable when booting. And I belive B0 means error, 32 or AF allways comes at the end when booting stops.
 
Ok so works with CPU in socket 1

Try a CPU in sockets 1 and 2

Then add the 3rd..... then 4th.

Possible bent pins, or bad socket. You need to isolate where the problem is.
 
Kendrak said:
Ok so works with CPU in socket 1

Try a CPU in sockets 1 and 2

Then add the 3rd..... then 4th.

Possible bent pins, or bad socket. You need to isolate where the problem is.
Click to expand...

This, if the BIOS settings are correct now, you are dealing with something else, you may be getting a short on one of the sockets and this could now be causing the CPU to not read and sending negative signal back to the NB.
 
Sounds like he's done all that. From top post:

The problem is that it will not boot when all 4 CPUs are assembled. It booting ok with 1, 2, and 3 or 1,3 and 4. Only 1 and 2 are visable in bios. When it is not booting it ending allways with code 32 or AF.
...
I have checked all the socket for damage, but they are all in perfect condition.
Click to expand...
 
I made contact with one engineer at SuperMicro in the Netherland, and he told me to assemble memory only for CPU1 with all CPUs assembled. I did, but there was no change.

He also asked me some question that I have answered, so I looking forward until tomorrow to se he can come up with.
 
Some things to check, make sure you plugged in BOTH 8-pin power connectors in addition to the 24-pin, I know this is a stupid one, but u never know! :)
 
I'd also double check to make sure you have ram in the correct slots for 4 cpus. Sometimes the order is a bit different than what you might expect and there is probably dedicated banks for each cpu. Your manual should have more details.
 
FrEaKy said:
Some things to check, make sure you plugged in BOTH 8-pin power connectors in addition to the 24-pin, I know this is a stupid one, but u never know! :)
Click to expand...


He already used all 4 8-pins connectors.

Have you tried to boot up with one (1) CPU and add another (one at a time)?

Is there any case that the board requires to have CPUs with same steppings? (SR-2 does)
 
sbinh said:
He already used all 4 8-pins connectors.

Have you tried to boot up with one (1) CPU and add another (one at a time)?

Is there any case that the board requires to have CPUs with same steppings? (SR-2 does)
Click to expand...

Never hurts to re-suggest...... ;)

jimh425 said:
I'd also double check to make sure you have ram in the correct slots for 4 cpus. Sometimes the order is a bit different than what you might expect and there is probably dedicated banks for each cpu. Your manual should have more details.
Click to expand...

Processors and their Corresponding Memory Modules
CPU# Corresponding DIMM Modules
CPU 1 P1-A1 P1-A2 P1-B1 P1-B2 P1-C1 P1-C2 P1-D1 P1-D2
CPU2 P2-E1 P2-E2 P2-F1 P2-F2 P2-G1 P2-G2 P2-H1 P2-H2
CPU3 P3-J1 P3-J2 P3-K1 P3-K2 P3-L1 P3-L2 P3-M1 P3-M2
CPU4 P4-N1 P4-N2 P4-P1 P4-P2 P4-R1 P4-R2 P4-T1 P4-T2

4 CPUs & 18~32 DIMMs
CPU1/CPU2/CPU3/CPU4
P1-DIMMA1/P1-DIMMA2/P1-DIMMB1/P1-DIMMB2, P2-DIMME1/P2-DIMME2/P2-
DIMMF1/P2-DIMMF2, P3-DIMMJ1/P3-DIMMJ2/P3-DIMMK1/P3-DIMMK2, P4-DIMMN1/
P4-DIMMN2/P4-DIMMP1/P4-DIMMP2 + any pairs in the other DIMM slots

For the memory modules to work properly, please install DIMM modules of the
same type, same speed and same operating frequency on the motherboard.
Mixing of RDIMMs, UDIMMs or LRDIMMs is not allowed. Do not install both
ECC and Non-ECC memory modules on the same motherboard.

Using DDR3 DIMMs with different operating frequencies is not allowed. All channels
in a system will run at the lowest common frequency.

And no, im not trolling, I know u listed the two types of memory you have used already, but im just posting information here that im finding about this.
 
jimh425 said:
I'd also double check to make sure you have ram in the correct slots for 4 cpus. Sometimes the order is a bit different than what you might expect and there is probably dedicated banks for each cpu. Your manual should have more details.
Click to expand...

I have tried to read the manual carefully, but it is quite technical and cryptic to understand, But I believe that I have done it right. Her is an example form the manual:

4 CPUs & 18~32 DIMMs
CPU1/CPU2/CPU3/CPU4
P1-DIMMA1/P1-DIMMA2/P1-DIMMB1/P1-DIMMB2, P2-DIMME1/P2-DIMME2/P2-
DIMMF1/P2-DIMMF2, P3-DIMMJ1/P3-DIMMJ2/P3-DIMMK1/P3-DIMMK2, P4-DIMMN1/
P4-DIMMN2/P4-DIMMP1/P4-DIMMP2 + any pairs in the other DIMM slots

The sticky part is "+ any pairs in the other DIMM slots"v

What does that last sentence mean?

If I do assemble all of the memory slots, 32 in number, then it is bound to be right, right?
 
Hi alias so they are all working in 1 and 2 put a CPU and memory in 3 and see if it boots use 1 stick of memory in 3 and if it does not boot try the memory in a different slot if no boot after that take the cpu out and memory out and move it to 4 and try the same thing there. If that fails then you are left with 2 possible scenarios either bad cpu sockets or the cpus you have are only for 2-P boards. I have heard rumors that some of the E5 chips may only be compatible with 2-P boards but I have not heard of that being confirmed yet.
 
Ah .. Freaky might be right .. try to use only 2 or 3 8-pins power connectors to see if it works... :D

My 4p H8GQL-iF+ uses only 2 8-pins while it has 3 8-pins sockets... If use all 3, it would boot.
 
Thanks, Grandpa_01.
Is it any ide to update the bios? The bios does not name the CPUs so you could be right in that they are 2P chips. Here is a picture of them:


Uploaded with ImageShack.us
 
sbinh said:
Ah .. Freaky might be right .. try to use only 2 or 3 8-pins power connectors to see if it works... :D

My 4p H8GQL-iF+ uses only 2 8-pins while it has 3 8-pins sockets... If use all 3, it would boot.
Click to expand...

Thanks, but I already tried so many things, that I do not now what to belive anymore. The chips are numbered so they should be possible to check if they are 4P or 2P. I also have a 60 day guarantee against DOA. 60 days guarantee is also provided.
 
I am thinking it might be a bad memory slot, maybe a short that is causing the problem, alias did you try it with single sticks when you tried or were all of the memory slots populated when you tried.
 
Best of luck.

Let us know how it all turns out. I hope you get folding on it soon.
 
OK the top right CPU in the photo has the stepping code QBEC, all the others look like they are QBED. Try booting with just the 3 QBED CPU's and then add the C one -. It is known for CPU's of different steppings not to like one another or work in a multi cpu board, E5's in particular. do an ebay search and there are plenty of 26xx that say they won't work in a multi cpu set up. I wouldn't bet against there being a similar problem withe the 4p chips.

Also i can't quite make out the stepping code properly on the lower right CPU is it a C or D?
 
Last edited:
Skillz said:
Looks like two QBEC and two QBED CPUs.
Click to expand...

I saw the same thing, top right and bottom right are either both C's or the bottom right is something completely different!

If thats the case, you may not be able to use all 4 together because there stepping is not the same.
 
Skillz said:
Looks like two QBEC and two QBED CPUs.
Click to expand...

I think that you are right, 2 of each. I will check that in a minute.

Grandpa_01 said:
I am thinking it might be a bad memory slot, maybe a short that is causing the problem, alias did you try it with single sticks when you tried or were all of the memory slots populated when you tried.
Click to expand...

I have tried all kind of combinations with memory sticks, and also tried another brand of memory, no change. There is no GBLAN visible either in Ubuntu so I v\can not communicate directly on the net. Is the GBLAN connect via CPU4 on this mobos?
 
Last edited:
Well those are engineering samples of E5-4650 processors, and they most certainly are 4P chips... have four of them in a system right next to me. (The E5-2xxx chips are the 2P units. However you can run E5-4xxx chips in a 2P board. LOL) But as others noticed it could be an issue of 2xQBEC and 2xQBED. I haven't read the entire thread carefully, but what happens with you put in, say, the 2xD chips in socket 0 & 1 and the 2xC chips in 2 & 3? Or vice-versa?
 
Yes there are 2 of each, I checked carefully now, and I will try what you suggest tomorrow, but that will be the last time I do anymore switch of those chips. They are about to become worn on the surface.

They are all working with the speed of 2.7GHz. Is there any 2P 26xx with same speed?

They where all annonced as C1 Stepping QBEC
 http://www.ebay.com/itm/Intel-Sandy...=653044966280126647&pid=100011&prg=1005&rk=1&
 
Last edited:
As an eBay Associate, HardForum may earn from qualifying purchases.
-alias- said:
Yes there are 2 of each, I checked carefully now, and I will try what you suggest tomorrow, but that will be the last time I do anymore switch of those chips. They are about to become worn on the surface.

They are all working with the speed of 2.7GHz. Is there any 2P 26xx with same speed?

They where all annonced as C1 Stepping QBEC
 http://www.ebay.com/itm/Intel-Sandy...=653044966280126647&pid=100011&prg=1005&rk=1&
Click to expand...

Yeah, seller sent u 2 D's and 2 C's than, so his sale was false.
 
As an eBay Associate, HardForum may earn from qualifying purchases.
No I mean, in his sale, according to your post, he announced them ALL as C1 Stepping QBEC, when you got 2 QBEC and 2 QBED, which means he didnt send you what he said he was selling.
 
Thanks, I got the point, and have make a notice of it for later maybe, I hope not!
 
From my experience, SM boards with different step code ES chips will not boot. Just to confirm that, you can put one of each in sockets 1 and 2 and I will bet the system will not boot.
 
402blownstroker said:
From my experience, SM boards with different step code ES chips will not boot. Just to confirm that, you can put one of each in sockets 1 and 2 and I will bet the system will not boot.
Click to expand...

This, once we saw the chips and saw the stepping, it clicked a bit.

Try like 402 said with 1 QBEC and 1 QBED in socket 1 and 2, if it doesnt boot up, it wont work.
 
-alias- said:
They are all working with the speed of 2.7GHz. Is there any 2P 26xx with same speed?
Click to expand...

Yes, there are, have two of those as well. (There was a method to the madness!) E5-2680 is the 8c/16t 2.7Ghz 2P version of the chips you have.
 
You must log in or register to reply here.
Back
Top