Network pics thread

rma said:
Sound expensive those fibers?, who will deliver the connection, google?

What about looking out for a Juniper SSG550?
Click to expand...

I'm located in northern Europe, so Google fiber is not really an alternative at this point :) It is from a (probably unknown) provider called "Altibox" which is sort of part of the power company. Price wise it isnt exactly cheap, but taken relative/domestic pricing into account its not all too bad either. Also with some real WAN speeds i can cancel most of the physical pizzaboxes (1U's) i have scattered around Europe, so price-wise i'll actually end up on top (just barely though).

The reason im getting 8 strands is simply due to the digging and setup costs (which will admittedly set me back a few grand), far outweigh the price of the glass, and it leaves room for expansion.

The SSG550 is really an interesting alternative, I was looking a bit at the ISG 2000, but the SSG550 seems like an even better alternative.. pfSense is truly great, but Juniper is Juniper. I'll have a serious think about that one :)
 
[ Infected ];1041906524 said:
I'm located in northern Europe, so Google fiber is not really an alternative at this point :) It is from a (probably unknown) provider called "Altibox" which is sort of part of the power company. Price wise it isnt exactly cheap, but taken relative/domestic pricing into account its not all too bad either. Also with some real WAN speeds i can cancel most of the physical pizzaboxes (1U's) i have scattered around Europe, so price-wise i'll actually end up on top (just barely though).

The reason im getting 8 strands is simply due to the digging and setup costs (which will admittedly set me back a few grand), far outweigh the price of the glass, and it leaves room for expansion.

The SSG550 is really an interesting alternative, I was looking a bit at the ISG 2000, but the SSG550 seems like an even better alternative.. pfSense is truly great, but Juniper is Juniper. I'll have a serious think about that one :)
Click to expand...

Gbit fiber in denmark are only for company's you can get it as a private but it's expensive :(

Anyway the SSG550 is really great :) and there should be some of them on ebay.
 
Last edited:
Since moving to AWS, I don't have anywhere near as large a collection of gear (and therefore gear pics). So I've instead put together diagrams of what I'm doing now.


Four locations: Home / classic data center / two AWS regions geo-load balanced behind Route 53. All connected via VPN tunnels.

overview.png




My home network: a cabinet in my detached garage with a fiber link to the house (not pictured is my Comcast Business internet that terminates in the garage).

File server, domain controller, utility box and two 24-core folding machines

home.png





Us-West-2: The heavy lifting region for my web sites. Autoscaling and load balanced web servers in three availability zones, autoscaling and load balanced DFS servers for local storage, two SQL Server 2014 servers, one MySQL RDS instance spanning two availability zones.

vpc1.png




US-East-1: For geo-redundancy and latency-based routing.

vpc2.png




For clarity, I've left out S3 buckets for IIS/CloudTrail/Application logs and the Redshift data warehouse.
 
vetman said:
Any problems with heat, cold, humidity or dust running the rack in the garage?
Click to expand...



MRTG running off of an external environment probe connected to one of my UPSes shows me that during any given day temperatures in the garage vary roughly 8 degrees over the course of the day. I keep temps somewhat regulated by the two window fans I have running to keep air circulating (one intake, one exhaust), with the intake fan set to turn on when temperatures rise over 68F. I was concerned about days with high dewpoints, but those haven't been a problem, either.

Over all my garage stays fairly dry but there are humid days here in the Pacific Northwest. Moisture hasn't seemed to be a problem in the two years I've been running this gear like this.

As for dust: Yes my garage gets dusty and I have filters cut from household furnace filters to protect the case fan intakes wherever possible. The in-garage window fans are not blowing directly on the gear by design to keep the dust down and to keep ambient temps down. I also do routine maintenance on my gear approximately one a quarter to clean out any accumulated dust and the occasional bug. But I don't do any dust-generating stuff in the garage (carpentry, etc) to try to keep the dust to a minimum, and so far I have not had any hardware failures, so the set up seems to be working okay.
 
cantalup said:
nice!!!

my garage is unsuitable , in summer: the peak temp is 100F or average on summer is ~90F..
Click to expand...

That is not unusual. Most garages are not insulated (except for the common wall to the house, if its attached). My garage would reach similar temperatures before I insulated the doors, walls and ceiling.

I have my servers under my house in the crawl space. Been there for two years without any issues. Of course I blow the servers out quarterly.
 
klank said:
That is not unusual. Most garages are not insulated (except for the common wall to the house, if its attached). My garage would reach similar temperatures before I insulated the doors, walls and ceiling.

I have my servers under my house in the crawl space. Been there for two years without any issues. Of course I blow the servers out quarterly.
Click to expand...

the garage is half insulated :D.
they did install insulation on the ceiling.
the other side wall is non insulated wall that next to shadow area,

summer is very hot...

the other non isulation is the garage sliding door :D..

my crawlspace is very humid in summer time too. and no concrete floor too.


but I already have the best solution: built closed rack enclosure that disguised as tv-top table :D
 
I need to implement temperature graphing for my setup. Would be neat to see. My server room tends to hover in the low 20C range in summer and low 10C range in winter. It's not fully walled in yet and the basement is not insulated so it's pretty much at whatever the ambient temp of the basement is. Something in the todo list. :D

100F that's crazy though, that comes up to 37C. :eek: I did get to experience that temp once, it was not very fun, but thankfully I was in a water park so we just kept finding ways to keep wet while waiting in line. Some of the overhead water slides had very leaky pipes which turned out to be a blessing.
 
Red Squirrel said:
I need to implement temperature graphing for my setup. Would be neat to see. My server room tends to hover in the low 20C range in summer and low 10C range in winter. It's not fully walled in yet and the basement is not insulated so it's pretty much at whatever the ambient temp of the basement is. Something in the todo list. :D

100F that's crazy though, that comes up to 37C. :eek: I did get to experience that temp once, it was not very fun, but thankfully I was in a water park so we just kept finding ways to keep wet while waiting in line. Some of the overhead water slides had very leaky pipes which turned out to be a blessing.
Click to expand...

I build arduino with temps/humids sensors with ethernet shield and mqtt
a python script logging front/rear/ambient temps of my closed rack to thingspeak.com

I can pull the data to CSV or other format..
 
cantalup said:
I build arduino with temps/humids sensors with ethernet shield and mqtt
a python script logging front/rear/ambient temps of my closed rack to thingspeak.com

I can pull the data to CSV or other format..
Click to expand...

That's the plan, I already have an arduino and another board pulling data, but I need to tie everything together nicely into a single system that's expandable. I will probably end up using a Raspberry Pi as it has GPIO pins so I can do i2c, etc and since it's also a computer my monitoring/control app can run on it too, then I can probably repurpose the existing environmental control server as a pfsense server and retire the existing box.

Right now I have data in text files using unix time stamp and then the value next to it, so when I implement the graphing capability in my monitoring app it will just pickup all that data. I was originally going to use mtrg to generate the graphs but could not really figure it out, it's ridiculously complicated for nothing. Was easier to just write my own libpng based library. :p
 
Red Squirrel said:
That's the plan, I already have an arduino and another board pulling data, but I need to tie everything together nicely into a single system that's expandable. I will probably end up using a Raspberry Pi as it has GPIO pins so I can do i2c, etc and since it's also a computer my monitoring/control app can run on it too, then I can probably repurpose the existing environmental control server as a pfsense server and retire the existing box.

Right now I have data in text files using unix time stamp and then the value next to it, so when I implement the graphing capability in my monitoring app it will just pickup all that data. I was originally going to use mtrg to generate the graphs but could not really figure it out, it's ridiculously complicated for nothing. Was easier to just write my own libpng based library. :p
Click to expand...

an example on monitoring my baremetal SSD/HDD

4qJcNtx.png
 
Wow that's pretty awesome.

Mobile app development is something I went to play around with some time. Though I always end up just making a web app then it's platform independent.

I still need to improve my monitoring app though, lot of features I want to add, but been busy with other stuff. I also want to combine the controls and monitoring into a single app and make it more modular. I want to be able to plug a new sensor on a 1-wire bus, i2c or even a custom protocol and just have it pop up. I don't think it would really be that hard to do with a raspberry Pi and some C++.

This is what I have now, still pretty primitive:





Though honestly, maybe I'm biased because I coded it, but I prefer my monitoring app to most of the stuff we use at work. Some of the programs we use at work are just so bulky and have lot of wasted space. I just want a list of all the alarms, not some 300 pixel high header! Even mine I will want to streamline more. Probably add a small js button that just hides it.
 
Red Squirrel said:
Wow that's pretty awesome.

Mobile app development is something I went to play around with some time. Though I always end up just making a web app then it's platform independent.]

I still need to improve my monitoring app though, lot of features I want to add, but been busy with other stuff. I also want to combine the controls and monitoring into a single app and make it more modular. I want to be able to plug a new sensor on a 1-wire bus, i2c or even a custom protocol and just have it pop up. I don't think it would really be that hard to do with a raspberry Pi and some C++.

This is what I have now, still pretty primitive:
Click to expand...
Same, here, using the one wire bus. And a server receiving it and building graphs and logging it. The android app is just really attaching to the database and showing the results...Its actually material design, so there are models for other stuff like UPS'es, Alarm monitoring, servers statistics, surveillance cameras and so forth. The sever is collecting data from some Raspberry pi and arduino units and brings it together for the app..





Though honestly, maybe I'm biased because I coded it, but I prefer my monitoring app to most of the stuff we use at work. Some of the programs we use at work are just so bulky and have lot of wasted space. I just want a list of all the alarms, not some 300 pixel high header! Even mine I will want to streamline more. Probably add a small js button that just hides it.
Click to expand...

Your app looks really nice :) I am just a C and java delveloper turned Android, so mostly im just playing around with it :) Next in line is to control the turbines ventilating the server room, but the arduino relay control part is not quiiiite done yet.. Also building a module for the rest of the house, and has a Moxa Nport for rs485 comms with the heat exhanger that is basically done, but that is a different app :)
 
Red Squirrel said:
...
I still need to improve my monitoring app though, lot of features I want to add, but been busy with other stuff. I also want to combine the controls and monitoring into a single app and make it more modular. I want to be able to plug a new sensor on a 1-wire bus, i2c or even a custom protocol and just have it pop up. I don't think it would really be that hard to do with a raspberry Pi and some C++.
......

Though honestly, maybe I'm biased because I coded it, but I prefer my monitoring app to most of the stuff we use at work. Some of the programs we use at work are just so bulky and have lot of wasted space. I just want a list of all the alarms, not some 300 pixel high header! Even mine I will want to streamline more. Probably add a small js button that just hides it.
Click to expand...

arduino or esp8266 platform are the easy shortcut..
arduino+ ether shield+ many sensors.. I build one closed air forced system with monitoring and controlling with arduino and mqtt :D.

Pi can be done easily to with sensor, since python IO library are in stable release...

i2c/GPIO/SPI are mostly interface that can be used in embedded system...
 
cantalup said:
arduino or esp8266 platform are the easy shortcut..
arduino+ ether shield+ many sensors.. I build one closed air forced system with monitoring and controlling with arduino and mqtt :D.
Click to expand...

Same here, using aruduino with ethernet shields and some simple C code to read and report the sensors, then the sever is just generating the rrdd graphs for me :)

Pi can be done easily to with sensor, since python IO library are in stable release...
Click to expand...

The Perl libraries which i'm using are also vey very decent.

i2c/GPIO/SPI are mostly interface that can be used in embedded system...
Click to expand...

Could not agree more, the interfaces are awesome :)
 
Red Squirrel said:
I need to implement temperature graphing for my setup. Would be neat to see. My server room tends to hover in the low 20C range in summer and low 10C range in winter. It's not fully walled in yet and the basement is not insulated so it's pretty much at whatever the ambient temp of the basement is. Something in the todo list. :D

100F that's crazy though, that comes up to 37C. :eek: I did get to experience that temp once, it was not very fun, but thankfully I was in a water park so we just kept finding ways to keep wet while waiting in line. Some of the overhead water slides had very leaky pipes which turned out to be a blessing.
Click to expand...


Hmmm, Guess I am really unlucky

47C Here in my garage last year..... only get like 10mins to play before things start shutting down.

BTW 15000 RPM HDD's burn the fingers when you run them in those temps ;)

.
 
lol ouch I can't imagine running equipment at those temps. Though I have seen some of our buildings get to 50C+ if the A/C fails in middle of summer. Definitely an emergency dispatch. :D
 
My servers love being under the house...

Temperature


Humidity
 
Last edited:
I can't imagine static would just happen sporadically. Just ground yourself if touching components. My house was always at 0-15% (meter wont go below 15) before I got a humidifier. If I set it higher than like 25 I get frost around all the windows so tend to keep it low.
 
according to most standards and recommendations you should keep the environment like this:


Temperature (these tend to change over time):
Low temp: 18C (~64,4F)
High temp: 27C (80,6F)

Humidity (do no operate above or under these):
Low: 40% RH
High: 60% RH


humidity inpact:

To low, will dry out grease in ball bearings in the harddrives and make them fail, static electricity will start to apere inside the machines from fans, and cripple the electronics.

To High, will cause electrolysis outside and inside of the equipment, again destroying the PWB's and chassie.

my experience is that it's better with higher humidity, then the lower, typical in electronics productions, we use very big humidifiers to keep the humidity NO lower than 30% RH.
 
rma said:
according to most standards and recommendations you should keep the environment like this:


Temperature (these tend to change over time):
Low temp: 18C (~64,4F)
High temp: 27C (80,6F)

Humidity (do no operate above or under these):
Low: 40% RH
High: 60% RH


humidity inpact:

To low, will dry out grease in ball bearings in the harddrives and make them fail, static electricity will start to apere inside the machines from fans, and cripple the electronics.

To High, will cause electrolysis outside and inside of the equipment, again destroying the PWB's and chassie.

my experience is that it's better with higher humidity, then the lower, typical in electronics productions, we use very big humidifiers to keep the humidity NO lower than 30% RH.
Click to expand...


Not once have I had anything die from low or high humidity. *shrug*

Probably matters when you have hundreds or thousands of servers.
 
Only reason I asked is because at my last job would get crazy low RH in the Winter months, like in the low teens. It was only a two rack server room, not a data center with spark emitting humans roaming around. Never had issues but I was always concerned after walking in from a carpeted floor outside the room.
 
b3nno said:
I cut a hole in the head, removed the brains (harddrive) and the noisy fans on this buddy:
....
JJSg5aa.jpg

Put a quiet radial fan from a Dell OptiPlex in, and found a CF-card slot under a panel underneath. Populated this with a 8GB CF-card with pfSense on it.
Sadly enough I have not been able to get the LCD working with lcdproc, not supported (yet..).
...
-Check Point UTM 270 running pfSense 2.2.1
....
Click to expand...


I have running low power baytrail D SoC motherboard J1800 with 8G RAM and some parts that I have available.
M5jQqJN.png

power consumption is 10W-15W(max)
average on 11W only!!
running proxmox 4.0 ( just upgraded 1 month ago) , all are virtualized.
IPCOP VM is running at the moment, moved from esx 5.5
two running debian VM are running, one is runngon openvpn , one is a house keeping (dynamic DNS updaters and etc...)
I uses onboard crappy realtek nic as a management port.

cost is minimal: $35 (mobo)+ $35 8G sodim RAM +$14 dc2dc atx powersupply, the rest are available from my spares

intel low power (appliance SoC) is very low power :D
baytrail mobo without additonal fans and with additio i340 nic dual port, 8W average :p.....
 
b3nno said:
snip
Click to expand...

Bought a new switch (2960S-24TS-L), a new rackmounted case (Norco RPC-4308) and a rack to hold everything, a Samson SRK8 on wheels:
CIY6vQJ.jpg

A two port LACP between firewall and switch, with several vlan-interfaces on top of it.

PDU on the back rails for power from the UPS:
vyxuBHR.jpg

Some length on the cables, for easy cleaning behind the rack.
BVxnxII.jpg


The E-ATX board was a tight fit in this case. Really pleased. The Norco RPC-4308 was listed as compatible with ATX only, but there was standoff holes for E-ATX, so that was weird...:
PSdmmFJ.jpg

LuRXA6f.jpg
 
Last edited:
b3nno said:
Bought a new switch (2960S-24TS-L), a new rackmounted case (Norco RPC-4308) and a rack to hold everything, a Samson SRK8 on wheels:
CIY6vQJ.jpg

A two port LACP between firewall and switch, with several vlan-interfaces on top of it.

PDU on the back rails for power from the UPS:
vyxuBHR.jpg

Some length on the cables, for easy cleaning behind the rack.
BVxnxII.jpg


The E-ATX board was a tight fit in this case. Really pleased. The Norco RPC-4308 was listed as compatible with ATX only, but there was standoff holes for E-ATX, so that was weird...:
PSdmmFJ.jpg

LuRXA6f.jpg
Click to expand...

I've looked at the samson racks before but thought they were short depth for audio equiptment.....

On amazon.co.uk is says the depth is 15.9cm!!! Can you confirm the depth please as I'm looking for a nice cheap rack.

Thanks!
 
paulwatson5 said:
I've looked at the samson racks before but thought they were short depth for audio equiptment.....

On amazon.co.uk is says the depth is 15.9cm!!! Can you confirm the depth please as I'm looking for a nice cheap rack.

Thanks!
Click to expand...

this is my understanding:
short(not- regular) depth server case would OK.
long depth (regular) server case is NO..///
 
That case is a short depth case (just under 16" long"), so from the picture I would say the samsons are short depth ~16" max depth for equipment.
 
You must log in or register to reply here.
Back
Top