Large DB server build

4

400+whpwrx

Gawd
Joined
Sep 27, 2003
Messages
557
Sooo looking to build a large DB server (mysql for now):

My questions are the following..

What Mobo can handle pci-e 8x in two slots?

Looking to go with two 12 or 8 port sata raid cards (adaptec 5805 possibly), but i am not sure on which mobo to use.

The mobo should be able to handle at LEAST 8gig if not 16 gigs of ram.

Dont care if it is dual slot or single (i can run 1 quad core just fine)

Now on to the disk side of things...

Which raid card to go with? Again i am looking at two separate arrays (one for tables, one for index's basically) of disks. Looking at 8 disks per array (maybe 12, but most likely 8), and thinking of 750gb drives given their current price point.


Example of the data sets im dealing with 1.5billion records in one table (largest table i have), and about 40 other tables 3 or 4 big ones with around 40-60 million records a pop.

So yeah.. i know i know i should have 20 servers all shard'd up and running mysql proxy and all sorts of fun stuff. but i dont have the budget for that just yet (its a side project/hobby).

So which "affordable" raid card and mobo would you go with?
 
i think you need to go with SAN,
and a machine which is going to run MySQL will be connected to the SAN via FC
 
Yeah that would be nice and all... buuutttttt

the budget isnt there :( so it is more of a "get the best you can on a budget"
 
I could recommend you server hardware, but I would need to know what kind of a budget you have. Moreover, this wouldn't be considered "affordable" as it would be a pretty decent server.
 
Do you actually need the storage space afforded by large 7200RPM SATA drives? If not, you'll probably get better performance by going with half as many disks with a higher spindle speed.
 
Anyone with 1.5 billion records that needs us to design a system is asking way too much.

I pass on building high performance systems. I could do it, but by the time I finished patching up the software and hardware it is much less hassle to find a shop that does this full time and can just clone a working system to a hard drive and assemble the right pieces.

You don't even say how much data transfer speed you need - hard drive or network.

You don't know enough to be building this system.
 
GeorgeHR said:
Anyone with 1.5 billion records that needs us to design a system is asking way too much.
...
You don't know enough to be building this system.
Click to expand...

QFT. Piece-meal assembled servers for a serious production environment = serious no-no. If you're on a tight budget, then you need to demonstrate to your employer/client the value of investing in a system that has a full hardware warranty with 4 hour response, that can be troubleshooted effectively by not just the person who assembled it.

This isn't a matter of hardware, this is a matter of expectations. Ask them what they expect, and see if that lines up with reality.
 
GeorgeHR said:
Anyone with 1.5 billion records that needs us to design a system is asking way too much.

I pass on building high performance systems. I could do it, but by the time I finished patching up the software and hardware it is much less hassle to find a shop that does this full time and can just clone a working system to a hard drive and assemble the right pieces.

You don't even say how much data transfer speed you need - hard drive or network.

You don't know enough to be building this system.
Click to expand...

Thanks for your arm chair quarterbacking.. it truly is appreciated...

Like i said this is a prototype system to just stand up and demonstrate some concepts on. Speed and efficency are not the target goal, this IS NOT a "production" system in any aspect, in fact production system for a project of this size would normally dictate a rack or two of servers with proper supporting network gear. Network speed is not the issue, my question to this forum was rather straight forward (maybe you should reread it).

So which "affordable" raid card and mobo would you go with?

ill even add a bit more.. looking for a mobo to support at least 8 if not 16gb of non ecc ram, support single quad core, two nics if possible. Stability is more what i am after vs overclocking (duh).

I have settled on the single card approach vs the two cards, so a 16port arcea is on its way.
 
Hunterzyph said:
QFT. Piece-meal assembled servers for a serious production environment = serious no-no. If you're on a tight budget, then you need to demonstrate to your employer/client the value of investing in a system that has a full hardware warranty with 4 hour response, that can be troubleshooted effectively by not just the person who assembled it.

This isn't a matter of hardware, this is a matter of expectations. Ask them what they expect, and see if that lines up with reality.
Click to expand...

No body expects anything, as no one knows what i am up to. :)

There are no clients, there are no employers, just a single guy with some code, some servers. and a dream.
*plays music in the background while the camera pans out*
 
Uhm okay
So any normal computersetup would suit you then. Depending on your personal demands Id suggest any normal motherboard based on Intel P35 Chipset, a dual or quad core cpu depending on your demands. Fileserving is not something difficult, but working against a database could be. Most boards support 8gb ram, not sure about 16gb. Regarding the controllercards Id go with 2x 8ports and two arrays. Incase one card die you only get downtime for one array. However, I would go with an extra card as well, just in case something would die.
 
You must log in or register to reply here.
Back
Top