New Backup System needed for new Office

MrGuvernment

Fully [H]
2FA
Joined
Aug 3, 2004
Messages
24,418
Now being in our new office, i want to consider a proper backup procedure and process, along with the hardware to follow through on it.

Right now, the backup system from our past office is coming over, but wont suffice, we have a server, using Syslog to backup MySQL database files, and most people doc, emails were hosted on this server, running raid 6 with 8 1T Hitachi SATA drives, burning to DVD weekly.


I wanted to know if some people here could help spec out a new backup solution, servers, tapebackup, software et cetera to implement for our new office, i am not completly sure where to start my self, so some direction would be great.

We will have: (all systems are windows - from XP,Vista, Server 2003 and server 2008)
  • 3 MySQL servers
  • 2 Domain controllers
  • 1 Server running OpenFire IM
  • 4 HTTP Servers (one day to be combined)
  • 1 Server that host VMs for remote desktop sessions for people (we have few people working around the world)
  • 19 desktop systems
  • 4 laptops that will come and go from the office.
  • In the coming weeks an Exchange server

I know i could just network most document folders and such to the current storage server we have and same with outlook files, but i want something more reliable, tape backups and all..

I want to go to my higher ups with some prices on various type of solutions we could possibly get...
 
I would love to suggest any number of products that the company I work for, for your setup. But frankly with the setup you are looking at, just grab Yosemite Server backup and you will be happy.
http://www.barracudaware.com/
 
I'd suggest switching from weekly to daily backups for whatever solution you end up with.

Using some crude numbers to quantify the output of employees to put it in perspective - 19 desktops + 4 laptops = assume 23 employees x 8hrs/day = 184 man hours/day x $75/hr billable (no idea here, just using a median number) = $13,800 per day. x5 for a week is $69,000 worth of productivity to protect.

If I told my boss we lost a weeks worth of work I'd be screwed.

For comparison, we have 15 workstations, 3 laptops, and 2 servers. I have clean build images of all the PC's (with software installed) to back up those (on-site and off-site). All actual data is on our main 2003 SBS server (including Exchange) and we use Symantec Backup Exec to a Dell LTO-2 tape drive. We do a daily/weekly/monthly tape rotation to off-site.
 
we had normal daily backups prior to a server change, i do plan to go back to the daily backup scheme :)

i was considering a dell LTO-2 drive, i assume it works on any system with a scsi card on it..
 
Depending on the amount of data you have, you may want to consider some products from Idealstor. The company I work for offers online offsite backup, but we find that for large amounts of data its just not that great, even with dedup.

Idealstor makes removable backup devices that are basically removable esata drives.

You can also try Shadow Protect for backing up those servers and desktops. It's basically like Symantec Backup Exec System Recovery but less expensive AND the incremental backups are delta-based. Meaning it only backs up the changes within a file at the block level. However, you HAVE to backup whole partitions with it. While you can recover single files and folders, it's not great for Exchange or AD related backups.

Yosemite is good as well, especially their unlimited price. However, there are still issues restoring single mailboxes from Exchange. Symantec Backup Exec 12.5 stills reigns supreme for me when it comes to granularity of restore options for Exchange and AD, but it is ASS expensive.
 
What is your corporate policy regarding local files vs network files?
 
Why not just use System Center DPM?

I have a client setup for short-term daily backups 4 day retention to a SAN, and then Long-term 3week retention for daily backups to LTO2 that are rotated off-site.
Works really well.
 
i was considering a dell LTO-2 drive, i assume it works on any system with a scsi card on it..

About 2.5 years ago when we got our Dell LTO-2 setup it was about $1800, came with the drive, SCSI cable and a PCI SCSI card.

Looks like Dell has moved their low-end LTO to LTO-3, here. Other than being LTO-3 that's what we got.
 
I don't know much about backups (we have our data, 2 mirror of the data on a second and third set of drives and incremental nightly backup on our server. We also have a third mirror and incremental nightly backups stored on a remote system, and we have a system to move mirrors off site.), but ...

A tape drive that uses 400GB tapes seems to be an expensive solution - $2000. $4000 if you expect your data center to be destroyed and need to restore from tape.

If the problem is to backup 8 1T drives (lets say 6T of data), a more reasonable solution would be to backup to four 1.5 TB drives $500. Keeping as many versions as necessary.

But then we don't know how the backup is going to be used.
 
What is your corporate policy regarding local files vs network files?

None yet, something i have to write, but it would be under my control, what i am going to do is move everyone's files off their desktops and server them from a raid 6 system, image their computers and be done with that side of it.

We will have an exchange server, which i will use IMAP from so emails also arent kept local at all and make for easier back ups.


Why not just use System Center DPM?

I have a client setup for short-term daily backups 4 day retention to a SAN, and then Long-term 3week retention for daily backups to LTO2 that are rotated off-site.
Works really well.

Anything is possible, checking out all my options first :)

Depending on the amount of data you have, you may want to consider some products from Idealstor. The company I work for offers online offsite backup, but we find that for large amounts of data its just not that great, even with dedup.

Idealstor makes removable backup devices that are basically removable esata drives.

You can also try Shadow Protect for backing up those servers and desktops. It's basically like Symantec Backup Exec System Recovery but less expensive AND the incremental backups are delta-based. Meaning it only backs up the changes within a file at the block level. However, you HAVE to backup whole partitions with it. While you can recover single files and folders, it's not great for Exchange or AD related backups.

Yosemite is good as well, especially their unlimited price. However, there are still issues restoring single mailboxes from Exchange. Symantec Backup Exec 12.5 stills reigns supreme for me when it comes to granularity of restore options for Exchange and AD, but it is ASS expensive.

right now the data shouldn't be exceeding about....30G at most a day to backup, i would like incremental for the laptop users, which we have 3 of, so when they come to the office, connect up, it will only backup what is needed, as opposed to killing their laptop performance copying every single thing over.
 
You need a supported, corporate level solution.

That leaves one option; Tivoli Storage Manager.

The client for each laptop or desktop will set you back $67 before discounts, last I looked. Configuration for laptops and desktops can be remotely managed to prevent users from changing it, and to ensure you only back up necessary files. Oh, and it's part of TSM's base functionality - no domain controller fun required.

Server side, it's all straight client functionality including full system restore, except for Exchange. Exchange requires an add-on module. Servers are licensed per core per chassis, meaning if you have an ESX server with 12 VMs on 8 cores, you license 8 cores and can install the server client on all 12 VMs.

Hardware requirements are not bad; you will require more disk, known as the TSM disk pool, but you'll also be backing up far less data. TSM does one backup of everything, and then only backs up what has changed until files expire. More realistic numbers for your daily backups will probably be in the 60-100GB range. Everyone claims way lower than it really is. Either way, you could easily run your TSM server on an IBM x3650 SFF with only one processor and 4GB of ram. The reason for the x3650 is so you can possibly get the entire disk pool in the single chassis.

Hit me with a PM if you've got any TSM questions; I can answer all of them. It's just too complicated a product to cover briefly in a forum post.
 
AreEss the info is much appreciated, this week i will hpoefully looking more into this matter now that i have some free time, kind of after our new firewall and PBX phone systems seem to be running retty stable.
 
def will check them out, i havent yet made any decisions on this so still keeping options open.
 
I can second the recommendation for TSM, it's what we use where I work and it is rather painless once you have it set up properly.
 
can TSM run on any server. IBM, Dell or HP? Does it work with tape drives and such from other vendors?

our ordering department can get things via HP alot faster and less hassle then trying to order from other companies apparently.
 
As far as I know, it can. I believe it supports just about anything. I'd check the documentation for it, they likely mention whether they have a driver for it or support someone else's driver. Where I work we're running it on Solaris 10 on Sun hardware, with IBM LTO3 tape drives, works well.
 
Just got some news that i may be taking on the administration of a branch office, their servers are located int a datacenter, how does TSM work for that? I can install a client applications which could dump data over to our servers in our offices?

(currently reading over the documentation and info on IBM's site)
 
IIRC, TSM will work over the internet just fine, and has options for encrypting data. Only issue then would be transfer speeds, I think, as backups may take a really long time depending on the connection available. It'd also cause issues if they were billed for traffic at the datacenter. But yeah, I think TSM will still work in that case.
 
The good news is the data to be backed up is in the data center of the ISP we use, which we have a 55mb/15mb fiber line into, or i can use the branch offices connection since they have now moved into the same building as us, so i guess not really a branch office any more.

Now, more fun, turns out they use CentOs on their servers :) something more to learn about!
 
CentOs should be fine, we're running a few clients on RHEL (essentially the same) and it works fine.
 
Ok, I must give my input to this subject. I have over 11 years of Enterprise level backup experience at fortune 50 companies. I am a Sr. Systems Engineer at one of the largest retailers in the country. My areas of expertise are Windows, ESX and Linux. I ran backups for a top 3 computer manufacturer for many years.

TSM is junk, stay as far away from it as you can. The company I currently work for uses TSM to backup thousands of servers (Windows, Linux, Unix and mainframe). I must say that the only group that is happy with TSM is the mainframe folks (go figure). The TSM folks think that their solution is NOT the only solution that should be performing backups. The tell us if their backups don't work "use your alternate solution". Very bad answer! In my 11 years in the I/T industry the only folks that like TSM are mainframe folks.

For a true enterprise class solution you want to take a look at EMC Legato Networker or EMC Avamar. Both of these products provide enterprise class backup solutions and support all of the major Operating Systems and applications (SQL, DB2, Exchange, etc). I will say that these solutions are not cheap but neither is TSM.

As far as TSM’s 1 full backup and incrementals forever, well it is not a good idea. In the 11 years I have been in this industry TSM is the only company that thinks this way. If it was a great idea every backup product would move to it. Let me ask you this. If you lose a server do you want to have to recall hundreds of tapes to restore it or a few from the week the failure occurred? Incrementals forever is NOT the way you want to go. Take a full backup on Saturday or Sunday and take an incremental all other days of the week. If you are writing to tape and sending it off to a storage location this is your best chance to NOT lose data. You need fewer tapes to perform a full system restore and you have less data to play back, meaning you can restore faster.
 
Awsome info Flash69, nice to have some veterans ring in on the topic, i am still going through this process and deciding on what to go with, been one heck of a busy last 2 months!
 
@MrGuvernment

Dear MrGuvernment, I hope you are open minded about my post and my full apology in advance to you and all other readers if you felt offended by my wrong choice of words

1. Initial query on August 09 and 5 months later still no concrete plans.
2a. Item 1 implies perhaps this plan is not so critical per management. OR
2b. This plan needs too much money and management could not understand/agree this investment.
2c. Reasons that other can fill-in.

I come from environment with limited resources. I sincerely suggest

1. Dual-PSU Norco 4220/4020 Setup fully filled with 16-20 SATA Disks. (since this is business please at least consider disk with RAID edition support) with 2 hardware-RAID cards. buy 2 cheap SATA controllers with eSATA ports. Buy 2 good PCI Express-based Intel Server Network Cards. Buy several units of external SATA Storage with eSATA connection (WD/SEAGATE/HITACHI/etc). Buy 2 low-cost 8-port 3com gigabit switches. if you wanted more buy HP 8-port with LACP support. Buy several Cat 6 cables. Remember to have good UPS. if your IT is old fashion, buy 56K modem for remote dial-in. Must buy setup with ECC memory.

2. Buy two sets of (item 1 as a whole).

Difference:

A. With proper vendor enterprise hw/sw/solutions, you have everything, but you also need to have enough money.
B. With above setup, you have enough hardware, but you need to do the work yourself.

Keypoint : we did not see any suggested budget figure

Use external SATA drive for offsite copy. You can encrypt if you wanted. Don't waste time with tape unless it is a corporate or legal requirement.

The most important point is the setup will ALWAYS have a use regardless of which way your IT wanted to go.

Note: obviously you are not going to build it yourself, I assume PC builder will address it for you. Ask them to change fans to low-noise version.

I think and invite other experience forum members to help you with all hw/sw details in case you accept this direction. I agree this is NOT enterprise-grade solution. Software can be commercial tools or OSS setup to reduce cost. As long as you can get your data back when it is needed and you are not fortune 1000 corporate, not 100% governed by enterprise-scale state and federal requirements...
 
Last edited:
light none taken, i know what you mean, this has been an ongoing matter.

I have taken steps in the mean time to assure some fail over, i am already copying to some SATA harddrives and taking them next door to another office for keeping.

i moved from the raid 5 to a raid 6 set up on our current server and added a hot spare.

i am burning to DVD (2 for each burn) and those go home with me, and in my news desktop i havea 3 drive raid 1 which data is also copied too.

I am covering my butt as much as i can to assure we have no data loss.

The reason why this has dragged on is because of budget constraints at the moment, massive internal reworking with in the company and such, and as you stated the upper's not always realizing how important backups can be.

I am definetly going to check that norco case with dual PSU, anything could be better then our current server!
 
I don't think HD based backup and LTO backup are the same thing at all. A tape is much more likely to function for you when you need it to (restore time) than a hard drive. The only way I'd feel truly comfortable with offsite HD backup is with a massive amount of redundancy, the kind that makes it very expensive and inconvenient. Tapes are cheap, the drives aren't so much but you'll sleep better with tape backups.

Dustin
 
I definetly want to go with tape backup, that has always been #1 in my list of must have items, but i didnt want to get a tape drive system until i knew the hardware that would go behind it.

I guess i am worried that if i buy a tape system, it may not work with the software i get to go with the system.
 
As long as you go with LTO you will be fine. All the major backup software support LTO technology.
 
good to know, looking at dell tape systems i always worried they may do something to their systems to make them not work on non-dell systems since some items they say it is compatible with X poweredge and so on.


I didnt seem to have mentioned a budget, but knowing our owners, and the realtive importance of the data, even though this hasnt been a quick process, systems i was looking at were in the range of $10-$15k US, to me that seems like a reasonable starting point to secure the companies data.
 
Buy the latest LTO tech (800GB native /1600GB compressed) the tapes cost the same as the old LTO tapes despite being twice the capacity, and the drive was only a couple of hundred more than the last gen LTO. I ended up with a Quantum drive because it was the best deal, but I've bought HP and Dell LTO drives before, they are all OEM'd from Quantum.

I'm not familiar with Linux environments, for Windows I recommend BackupExec - they keep it updated regularly, and as far as tape backup software goes it's a decent mid point between complexity and capability.
 
Back
Top