Suggestions for a new backup strategy

iroc409

[H]ard|Gawd
Joined
Jun 17, 2006
Messages
1,385
I'm working on a new backup strategy right now, and I'm open to some suggestions.

I have a FreeBSD/ZFS file server. I have been running 3 USB 3.0 drives in rotation, swapping one out about once a month. It does daily regular rsyncs, and once a week does a checksum rsync. The drives were over 90% full, so I was starting to seek a replacement when one of the drives died. It was a Seagate external, so no real suprise (they aren't well ventilated).

Since they were almost full, I wasn't sure what I wanted to do but didn't want to spend a ton of cash. So, I bought a 5TB Seagate (durr). I changed my backup so all my documents/backups went to the remaining two 3TB USB drives (both WD's). Then all my media backups went to the 5TB, changing it to once a week only backups.

Now I've had another of the 3TB WDs fail. These are all a few years old, so I guess they are just getting to EOL. While I was working on getting things back to normal, I rebooted the server and USB freaked out. It booted my UPS off, stopped recognizing the 5TB, and wouldn't disconnect the missing 3TB (zpool export). I restarted, got it to see the 5TB drive, and export/disconnected it. I use a StarTech USB3.0 controller with NEC chipset, as the server doesn't have built-in USB3. I had a little bit of panic thinking if anything happened to the array, the rest of it would have been gone as I only have the one 5TB backup.

I only have about 600Gb right now of backups/documents/pictures. I've thought about getting a few 2TB 2.5" externals, as I have good luck with the smaller drives, and maybe getting another 5TB drive to rotate media backups. Fairly costly, and I'm worried with two drive failures pretty close (and occasional USB3 unreliability), that I might continue to see failures.

Another option, more desirable maybe, is to actually have a backup server. I didn't really want to spend that much cash right now, though. I could use the board from my old server, but it's pretty old and uses a lot of power. Eventually, when we buy our next place, I'd like to have a shop and put the backup server in the shop. I'd still need to off-site the irreplaceable stuff, but it would provide pretty good resiliency--and if both buildings burnt down, I have more to worry about than what's on the backup. With a backup server, I could also switch over to zfs snapshots, which is probably a better method.

The server also has an eSATA port. I've not really used eSATA with FreeBSD, but it should work fine. I just don't want to have to restart every time I swap a backup. I could buy 3 eSATA enclosures, and some drives that are big enough for now, and go that route.

I've considered replacing the USB3.0 controller as it's older than the server. I also thought about removing it and just using USB2.0. However, weekly rsync backups can take almost 24 hours, so I think that would extend that by a long time. It might work for just my documents backups.

Those are kind of the options I am looking at. I'm open to any ideas that may be more appropriate, or which of these would be best.
 
This isn't a very popular choice, but have you considered optical discs for files that you won't be using for a long long time? (like old family holiday pictures).
I currently use BD-Rs to backup all my stuff, the main advantage I see is that if one dies, it won't take everything with it.
 
You cannot trust any storage without verification.
CDR, DVDR or BD, you cannot trust without checksums.

ZFS has checksums so the best is to use ZFS for backups.
Add any ZFS raid to repair silent data errors on regular scrubs.
 
I went and picked up a couple 2TB 2.5" drives today, as I was right next to a Costco for a couple other errands. Unless I come up with a better plan, I think I will use these for my documents/off site, and keep the single 5TB to backup my media stuff. Not perfect, but should be fine in the interim.

I'll move toward getting a backup server running, in which case I'll backup to it and use the 2.5" still for off-site. Hopefully I can get it running soon.

This isn't a very popular choice, but have you considered optical discs for files that you won't be using for a long long time? (like old family holiday pictures).
I currently use BD-Rs to backup all my stuff, the main advantage I see is that if one dies, it won't take everything with it.

I've thought about this quite a bit, and may consider doing it for photo archives. I have a lot of stuff poorly organized in documents that I don't want to lose, and there's enough to make BlueRays difficult. For my photo stuff though, this would probably be a good idea--especially when I get through scanning my old negatives.

You cannot trust any storage without verification.
CDR, DVDR or BD, you cannot trust without checksums.

ZFS has checksums so the best is to use ZFS for backups.
Add any ZFS raid to repair silent data errors on regular scrubs.

My external drives are single-disk zpools. No redundancy, but at least they are checksummed/scrubbed.
 
Why not online backups?? Crashplan runs on FreeBSD and its rather cheap, even lets you use your own Blowfish encryption. You could also use Amazon Glacier storage, its rather cheap too at $0.01 per GB, free upload transfer and cheap download. 10TB is only about $10 a month plus its encrypted too.

Honestly online backup is the easiest way to do offsite back if you don't have a family member or friend who is willing to host a server for you. A simple cron job, snapshot based backup with compression will keep things simple.
 
No reason you can't send/recv snapshots now; that doesn't require a separate server, just a dataset.

Yeah, that would work, but I have an odd collection of folders and datasets--so I'll have to look that over. Not sure why that is, but I set up the file system years ago and don't remember why or how it was done that way. I will look into re-creating it to fit better.

Why not online backups?? Crashplan runs on FreeBSD and its rather cheap, even lets you use your own Blowfish encryption. You could also use Amazon Glacier storage, its rather cheap too at $0.01 per GB, free upload transfer and cheap download. 10TB is only about $10 a month plus its encrypted too.

Honestly online backup is the easiest way to do offsite back if you don't have a family member or friend who is willing to host a server for you. A simple cron job, snapshot based backup with compression will keep things simple.

I've been hesitant to do online backup, but I guess I should look into it more.
 
3-2-1 rule is still in power

http://blog.trendmicro.com/trendlabs-security-intelligence/world-backup-day-the-3-2-1-rule/

so at last 3 copies of data scattered between diff locations all around the world

blurays are positioned as being suitable for data vaulting but ones i've recorded many years ago had melted so hope medium quality had improved

general overview

http://blog.digistor.com/lean-on-longevity-reliability-of-blu-ray-data-archiving-solutions/

This isn't a very popular choice, but have you considered optical discs for files that you won't be using for a long long time? (like old family holiday pictures).
I currently use BD-Rs to backup all my stuff, the main advantage I see is that if one dies, it won't take everything with it.
 
3-2-1 rule is still in power

http://blog.trendmicro.com/trendlabs-security-intelligence/world-backup-day-the-3-2-1-rule/

so at last 3 copies of data scattered between diff locations all around the world

blurays are positioned as being suitable for data vaulting but ones i've recorded many years ago had melted so hope medium quality had improved

general overview

http://blog.digistor.com/lean-on-longevity-reliability-of-blu-ray-data-archiving-solutions/

I have 3 copies of most of my data... but it's only on one type of media (hard drives) and none of it is off-site yet.

I would have no problem rotating hard drives to a safety deposit box or a family member's house to facilitate the off-site requirement.

But backing up to different media would be a pain.

Are people really using alternative media for backup? Even with 100GB Blu-Ray discs you'd need 10 of them to backup a 1TB hard drive. And you'd have to catalog all that data that you separated into 100GB chunks.

I like the fact that Blu-Rays are long-lasting plastic discs with no moving parts... but it seems like it would be a pain to get all your data onto them. (and getting it off again if disaster strikes)

On the other hand... hard drives are HUGE and you can duplicate a hard drive in one shot in a matter of hours. I could turn 3 hard drives into 4 hard drives with minimal effort. Boom... 4 copies.

Of course hard drives can fail... but what are the chances that all 4 would fail at the same time?

If I started rotating the hard drives off-site... would solely sticking with hard drives be enough?

Or do I need to use other media like Blu-Ray or even tape?
 
I have 3 copies of most of my data... but it's only on one type of media (hard drives) and none of it is off-site yet.

I would have no problem rotating hard drives to a safety deposit box or a family member's house to facilitate the off-site requirement.

But backing up to different media would be a pain.

Are people really using alternative media for backup? Even with 100GB Blu-Ray discs you'd need 10 of them to backup a 1TB hard drive. And you'd have to catalog all that data that you separated into 100GB chunks.

I like the fact that Blu-Rays are long-lasting plastic discs with no moving parts... but it seems like it would be a pain to get all your data onto them. (and getting it off again if disaster strikes)

On the other hand... hard drives are HUGE and you can duplicate a hard drive in one shot in a matter of hours. I could turn 3 hard drives into 4 hard drives with minimal effort. Boom... 4 copies.

Of course hard drives can fail... but what are the chances that all 4 would fail at the same time?

If I started rotating the hard drives off-site... would solely sticking with hard drives be enough?

Or do I need to use other media like Blu-Ray or even tape?
HDDs seem more practical for your use case.
I personally use BluRays, because I have no problem separating my data (mostly old TV shows so 1 season per disc).
I have a small folder I call "The Archive" that's mirrored on Google Drive, and I name, and write on my disc alphanumerically (S0001,S0002,... etc.).
Keep in mind my use case is not so much "backup" as it is "archiving" since I only have one copy of each disc. Which for me seems to give BluRays an advantage since if one fails, I won't lose everything.
 
Look at Crashplan, seriously. It runs on OpenIndiana for me, another person mentioned FreeBSD works too. Most importantly for your situation, they do a seeded backup option. It costs extra but helps the terror factor. Its a 1TB drive, which would work for the 600GB of documents you mentioned.

Basic steps:
- Sign up for Crashplan account, install client software, do not bother starting backing up online yet
- Sign up for the seeded drive option
- They send you the drive, run your first backup to that drive
- Ship the drive back to Crashplan
- They import it to your account (overwrites anything you have in there)
- You resume the backup in the client software on your NAS, it picks up where it left off and updates the online copy with new files

I did this when I started having issues with my Seagates getting EOL (had one die in my RAIDZ2, then another started flaking out the next day during the resilver....).

The Crashplan seeded backup is a life saver.
 
you can always use something like winRAR/7zip to create 99GB zip files. You can turn the whole drive into a zip file broken up into parts. That way you know what parts are what and its organized.

Part 1
Part 2
Part 3
....

All of them are 99GB and combined makes all your data. I use this method for transferring large files over the internet to friends since transfers always brick and restart. I am unsure how hard that would be on a computer when its dealing with TB volume and not GB volume but i bet using no or little compressing would world fine.
 
A few things I've done to mitigate a storage loss (I just went through one when my USB drive OS sheared off).


1. USB/NAS RAID Backup: Pickup one of those USB/NAS 4 bay systems for dirt cheap, slap in some disks, congrats you have a live backup running on disk. USB is preferred for Option 2.

2. Install Backblaze on a PC(Mac/Win) and upload your USB RAID array to Backblaze. This will take a LONG time depending on your upload speed and space.

3. Google Apps for Business: Pay a small monthly fee, upload your data to google. Business section allows 'unlimited' data sync and works on nearly every damn thing out there. Amazon's new service works too and is relatively the same price. Best thing is you get access to everything via the web securely.

4. Buy another backup server: Buy another server, slap in drives, keep it running in another room.

What I do is this:

1. All files goto my SAN.
2. A daily rsync job goes from my SAN to both my USB drive on my PC and to my backup server. Each backup system runs the job independently at staggered times.
3. My PC uploads changed files to Backblaze from my USB drive. Backblaze only supports 'local' disks.
4. A rsync job goes to a Patriot NAS device from my USB drive on my PC in a separate room in the house.


I have multiple copies of my data with at most a day's loss.

If my main server dies, I have a backup server, if my backup dies server, I have the USB drive, and if the USB drive I have that Patriot online.

Backblaze keeps my data uptodate daily so if my house burns down I can call them and pay the price to send me all the data via an external drive.

I have ridiculous overkill I know but I"m a digital horder.
 
6-8 tb single drives are not that expensive. I just have 4, rsync once a week to one of those trayless hd bays. Then i just take the drive to workin an esd baggie. Its not the best plan since i can only go back 30 days, but hey 30 day time machine is $1000, a single week is only $250.

You can get those shingle drives that are 8tb for $260 if the retailer only charges retail for them.
 
6-8 tb single drives are not that expensive. I just have 4, rsync once a week to one of those trayless hd bays. Then i just take the drive to workin an esd baggie. Its not the best plan since i can only go back 30 days, but hey 30 day time machine is $1000, a single week is only $250.

You can get those shingle drives that are 8tb for $260 if the retailer only charges retail for them.

The Shingle (SMR) drives are meant for a write once and read maybe. They are big and they are slow, but they will hold tons of data cheaply. They are the ultimate cold standby drives. I'm waiting for the 8TB to come down around the low $200s and then I'll pick a few up. Also those drives are HORRIBLE in a RAID, can't be used at all reliably which brings up another methodology on how to properly use them.

Read this review to show that RAID+SMR=BAD IDEAR
http://www.storagereview.com/seagate_archive_hdd_review_8tb
 
Last edited:
Back
Top