A small datacenter build and other projects

The Spyder

2[H]4U
Joined
Jun 18, 2002
Messages
2,628
*Updated for new readers

I work as the IT Manager for a small, but growing company building custom 3d Image processing and terrain mapping software. Our software runs on custom built portable clusters and storage systems.
In this thread you will find my photo blog of ongoing projects since I started and updated as often as I can. Current projects include building a small warehouse data center, upgrading our multi site network,
and rebuilding our virtualization environment.


To answer some basic questions:
Permission has been granted by my boss to post the following photos.
Most of the gear in cases are from SKB and is customer owned.
We have over 2PB of storage across multiple countries.
Each cluster consists of 20 nodes (Dual Hex Core, 96gb ram, 2x 256gb SSD), 2 Controllers (Dual Hex/96gb ram/SSD), a Datastation (Dual Hex/196gb/SSD/LSI controllers/336tb spindle disk.)
We outgrew 1gb, tried 10gb, but ended up using 40gb Infinband.
They do not make hardware fast enough for us, which keeps things interesting. :)


Pictures from when I started:

Engineering+ Cluster1 server room (temporary, we have 2x 30amp 120v and 2x 20amp 120v power)


Main server room:


My 24kw (2 Ton) AC, largest I can get right now due to other restrictions.)


Oh jebus...


Main servers, storage, ect.


Cable management? Naaaaa....


It dosen't get any better...


"Engine Room" network closet where the internet comes in...


At least it's pretty!































































 
Last edited:

cyr0n_k0r

Supreme [H]ardness
Joined
Mar 30, 2001
Messages
5,358
Just FYI a lot of your pictures are repeated.
Looking good though.
 

The Spyder

2[H]4U
Joined
Jun 18, 2002
Messages
2,628
This is only what I can show, well at least for now :)

We are currently hiring software engineers, if you can't find the name of the company and website based off the pics, I wouldn't hire you :p
Since I am one person for all of this, I am begging my boss for a helper.
 

Brak710

[H]ard|Gawd
Joined
Oct 27, 2008
Messages
1,424
I have no how one person could handle this. If they don't give you a helper.... I'll do it for free.
 

The Spyder

2[H]4U
Joined
Jun 18, 2002
Messages
2,628
In 2.5 weeks I did 127 hours? I left at 3:30 today because I was 16 hours over for this week already. Thankfully I have nothing to do with production (software or hardware) and I just maintain the gear. :)
 

PigLover

[H]ard|Gawd
Joined
Jul 11, 2009
Messages
1,180
This is only what I can show, well at least for now :)

We are currently hiring software engineers, if you can't find the name of the company and website based off the pics, I wouldn't hire you :p
Since I am one person for all of this, I am begging my boss for a helper.
1st Ave, Portland, right? Or are they just one of your suppliers?
 

Jay_2

2[H]4U
Joined
Mar 20, 2006
Messages
3,583
My god I wish I could get investment like that from our Multi national multi million $ company!

Trying to get them to buy 1 VNXe has taken over 6 months and I am still no further forward $10,000 on a few Apple PCs is easy to get the OK for though.
 

l3thal6

Limp Gawd
Joined
Oct 26, 2011
Messages
322
Well, that gives me motivation to keep studying and getting certified, so someday I can be part of an epic project like this!
 

corge

Limp Gawd
Joined
Sep 21, 2009
Messages
248
what are the green usb dongles handing out the back of a few of the servers??
Most likely the boot drive maybe?

On my supermicro storage devices, we run FreeNAS for basic storage (NFS) and I use USB drives as the boot drive for them.
 

calvinj

[H]ard|Gawd
Joined
Mar 2, 2009
Messages
1,738
No kidding I just got done drooling as well.

This is some Sexy work here man. Keep the posts coming. I wish I was building a new data center. I don't think I'll get that option for a while. I'm on my way out the door of this job as of Friday into a much larger company. Not sure what I'll get to do
 

schnell

Gawd
Joined
Jul 22, 2005
Messages
763
Most likely the boot drive maybe?

On my supermicro storage devices, we run FreeNAS for basic storage (NFS) and I use USB drives as the boot drive for them.
I am guessing software keys. If they were booting off the flash drives they would be inside the servers. Pretty much all modern servers have at least one internal USB port for booting off of.
 

The Spyder

2[H]4U
Joined
Jun 18, 2002
Messages
2,628
Between being sick and overloaded, I present you with more assorted pictures. Hopefully this weekend I can update the posts and clean them up.















 
Last edited:

schnell

Gawd
Joined
Jul 22, 2005
Messages
763
Nice tools. Those R210's are cute little servers aren't they?

What company makes those rolling racks I keep seeing? I have some mobile PBX equipment that could use a nicer home.
 

scobar

.
Joined
Jan 2, 2001
Messages
34,365
Nice dude. One of those cameras could find their way here, my canon 70-200 f2.8L MK II would like that:)
 

The Spyder

2[H]4U
Joined
Jun 18, 2002
Messages
2,628
I have been a huge Milwaukee fan for years. Until the bastards went to China. I own 20+ pre china Milwaukee tools and every one of them is a tank. I snapped the chuck off my 1/2" Right Angle drill once, they fixed it no charge at the local service center when it was outta warranty. I bought one of their first Made in China v18 drill sets and it has just been a piece. The battery life sucks, the tools are heavy as heck, and they just don't work as well as the old stuff. I bought a M18 impact driver/drill and promptly built two sheds and used it to strip a car. So far it is holding up much better, but I can't help but wondering when it is going to fail.

Now I realize Makita has also moved most its production to china, but it was a 50/50 shot here and I heard good things so I figured it was time to try them. Great little tools. We have the 18v set in our assembly area and the guys love it.My first drill was a Makita 9.6v, I still have it somewhere. Still works too :).
 
Joined
Feb 4, 2012
Messages
27
WOW! I don't think I can "technically" look at these pictures on my work computer since they are "technically" considered porn. Seriously though, please keep updating these pics. My jealously grows stronger with each one. :D
 

ben chi(f4)

2[H]4U
Joined
Mar 4, 2008
Messages
2,338
Brb, gonna go play on my 144 GB Dual Intel Xeon X5680 Server.. I got some number crunching to do. :D

Very nice photos BTW.
 

Ockie

*** Self Proclaimed Storage King ***
Joined
Mar 2, 2005
Messages
17,991
My 24kw (2 Ton) AC, largest I can get right now due to other restrictions.)
I think you meant to say 24k btu (if that is the classic 26 movin cool), which is 2ton. 2ton is about 7KW :)
 

The Spyder

2[H]4U
Joined
Jun 18, 2002
Messages
2,628
Haha yes! This would be a 7 Ton unit. I am adding another 12k BTU portable to our R+D lab. These older x5650's really put out some heat!
 

Ockie

*** Self Proclaimed Storage King ***
Joined
Mar 2, 2005
Messages
17,991
Haha yes! This would be a 7 Ton unit. I am adding another 12k BTU portable to our R+D lab. These older x5650's really put out some heat!
No, it's not a 7 ton, it's a 2 ton. Kilowatts and Tons are very different units of measurement.
 

schnell

Gawd
Joined
Jul 22, 2005
Messages
763
Who is the manufacturer of those rolling racks? I could use a few of those for some mobile PBX gear.
 
Top