Full fileserver encryption/Other questions about my project..!

WestSidaz

Limp Gawd
Joined
Jan 13, 2011
Messages
223
Hello all.. :cool:

again i have couple questions about hardware and software.. been reading different kind of topics for hours but its funny how reading topics makes new ideas and how ideas can be made... :D

Now what i have planned to do..

I have been planning to make atleast 40-50 tib fileserver what is FULLY encrypted standalone server @ the basement..


Now i need couple tips and ideas from u guys how i should handle this case and what is and what isnt possible to do..



Have been thinkin about

- using WHS or W7... i am familiar with W7 already but would WHS be better for the fileserver system?

- encrypting ALL data... windows hdd and all files.. with TrueCrypt..

-Acces to all data via home network... Is it possible to get fully working files like movies from encrypted server to a computer what dosnt have encryption, just moving stuff over the network? Or will all data what i try to transfer over the network be unreadable data in uncrypted computer.. ?

- maybe using 2 windows hdd´s in raid1 mode.. coz it is a standalone server, it might be better to use raid1 if other windows hdd crashes, it can be replaced easily with other hdd and everything works fine... Right? How would it work with encryption?

- using 2 x normal HDD or should i use 2 x SSD if i decide to go with RAID1.. ?? this is critical thingy.. SSD vs normal HDD in encryption.. been reading alot about this case but still not sure wich i should take.. normals might be better choice but what u guys think?

- encrypting all data like this (takes LOTS of time and i have it..) coz fresh instal of windows + sas controllers i think that preventing data losses it would be easiest to add clean hdd´s to case and encrypt one by one... Like this.. Clean hdd -> encryption -> transferring data from other hdd(USB or E-Sata) to that encrypted drive -> data will be encrypted without any data loss and with clean instal -> after moving all data from other hdd(USB or E-Sata), it gives me a new clean hdd where i can start whole process all over.. so every moved data will be moved to a clean fully encrypted hdd..



more ideas can be added later..


I know this might and does sound really crazy idea and some of u might think "what a moron" but if this project can be done by the terms above, i will do it..

So now i need ideas from u guys.. Can it be done? If can or cant be, tell me your ideas... any questions? Just ask!
 
i suppose you cannot encrypt your system-os-drive.

with 50 TB i would prefer a ZFS system due to its handling of silent data corruptions.
with ZFS-scrubbing (online filecheck that can repair errors also on open files)
beside all other capabilities

with Solaris Express 11 you have also full pool encryption in a very easy manner.
just add a pass-phrase when creating and mounting a ZFS filesystem

Gea
 
Truecrypt can encrypt OS partitions. It comes with its own bootloader that asks for a passphrase at boot-time.
 
manifesto = back button.

you'll get better answers if you make your OP brief, with specific questions, and try to avoid posting in stream of consciousness form.
 
You can encrypt any disk device OR parition that has been created with truecrypt and then share it over the network just fine.

For your system:

Create your raid array with hardware you have, either raid 1 or 0 or whatever. Install your OS. Install truecrypt, encrypt the system partition using TC full disk encryption. If you lose a disk with raid 1/5/6, just replace it. The raid hardware doesn't care what data is on there. The only drawback is that if you have some catastrophic failure, no disk recovery tools will be able to pull files off of the disks.

Data disks:

Create your array via your hardware raid controller, whether it's JBOD or Raid6 or whatever. Boot your installed OS. It will show up in disk manager as an unformatted unitialized device of course. Initialize it, create your partition(s).

Don't format the disk, take truecrypt and select encrypt non system disk or device, encrypt the partition(s) you created.

Mount the partition as a drive. Then share the newly mounted drive out. You will have to recreate the share each time you reboot the computer though. Use a script for that. See here for some examples:

http://www.edugeek.net/forums/scripts/23019-script-share-multiple-folders.html

Nutshell:

create partitions
encrypt partitions
mount encrypted partitions
share partitions
done

Since it seems you're paranoid, something else you can do for your OS is create a ram disk, then point all of your temp system variables at it. Particularly temp and tmp and whatever else you want. browser cache, cookies, etc. Set the disk not to save on shutdown. Then all your temp data goes poof every reboot.
 
Truecrypt is completely transparent to the filesystem. It only makes sure that no data gets to disk unencrypted. Everyone that has access to the network shares or can log in to the server itself will have full file access. For this reason the data is only completely safe if the OS is shut down.

- using 2 x normal HDD or should i use 2 x SSD if i decide to go with RAID1.. ?? this is critical thingy.. SSD vs normal HDD in encryption.. been reading alot about this case but still not sure wich i should take.. normals might be better choice but what u guys think?

- encrypting all data like this (takes LOTS of time and i have it..) coz fresh instal of windows + sas controllers i think that preventing data losses it would be easiest to add clean hdd´s to case and encrypt one by one... Like this.. Clean hdd -> encryption -> transferring data from other hdd(USB or E-Sata) to that encrypted drive -> data will be encrypted without any data loss and with clean instal -> after moving all data from other hdd(USB or E-Sata), it gives me a new clean hdd where i can start whole process all over.. so every moved data will be moved to a clean fully encrypted hdd..

1. You don't need SSD for the WHS. If you build a proper server with 40-50 TiB it should have enough RAM to keep everything important of the OS in memory anyway.

2. The scenario you described would result in a lot of disks with separate file systems. This would result in like 16 partitions even if you use 3 TB drives. Like the last poster said, you should create reasonable sized RAID5 or RAID6 arrays, encrypt the resulting RAID "drive" and create the filesystem on top of that. You can then later move all of your files preferably over network to the server and it will be encrypted on-the-fly.
 
Last edited:
Truecrypt is completely transparent to the filesystem. It only makes sure that no data gets to disk unencrypted. Everyone that has access to the network shares or can log in to the server itself will have full file access. For this reason the data is only completely safe if the OS is shut down.

Which is why it doesn't make sense encrypting server data, at least not at the volume level. The server is on all the time which means the data is fully accessible anyway. Volume encryption makes sense for devices that have a chance of being lost or stolen - PDAs & smartphones, tablets, laptops, USB hard drives etc.
 
Last edited:
Which is actually what I wanted to say, maybe I omitted to much of the conclusion. :D
But the OP did not state why he wants to implement encryption. Actually I personally think that it makes sense to encrypt every harddisk at the volume level because it is much easier to dispose of such a drive safely and it comes at a very tiny overhead for modern systems. You have to just throw away the key.
 
i suppose you cannot encrypt your system-os-drive.

with 50 TB i would prefer a ZFS system due to its handling of silent data corruptions.
with ZFS-scrubbing (online filecheck that can repair errors also on open files)
beside all other capabilities

with Solaris Express 11 you have also full pool encryption in a very easy manner.
just add a pass-phrase when creating and mounting a ZFS filesystem

Gea

Yeah i guess smth else than windows might be better for larger fileserver... but i am windows fanboy so it is kinda hard for me to use any other os than winblows in computer..

manifesto = back button.

you'll get better answers if you make your OP brief, with specific questions, and try to avoid posting in stream of consciousness form.

Yeah would have been really better to make it better... so dont do topics around 6 am!

1. You don't need SSD for the WHS. If you build a proper server with 40-50 TiB it should have enough RAM to keep everything important of the OS in memory anyway.

2. The scenario you described would result in a lot of disks with separate file systems. This would result in like 16 partitions even if you use 3 TB drives. Like the last poster said, you should create reasonable sized RAID5 or RAID6 arrays, encrypt the resulting RAID "drive" and create the filesystem on top of that. You can then later move all of your files preferably over network to the server and it will be encrypted on-the-fly.

1. i have 8 gigs of 1066 MHz ram.. so shouldnt end..

2. i have a norcos 4224 case so 24 hdd´s + 1-2 windows hdd´s.. deppens do i make raid1 or non raid windows base.. non of the 24 hdd´s will be raided.. this is fully a storage server.. not gonna even instal a web browser in it.. except winblows explode what comes with os..

Which is actually what I wanted to say, maybe I omitted to much of the conclusion. :D
But the OP did not state why he wants to implement encryption. Actually I personally think that it makes sense to encrypt every harddisk at the volume level because it is much easier to dispose of such a drive safely and it comes at a very tiny overhead for modern systems. You have to just throw away the key.

Well.. i have lots of backup copies from movies ;) so encrypting is cool..

and i really dont dispose hdd´s.. mostly i just run em aslong they lives.. except when warranty is still kickin but it happens really rarely...
so u think it would be best way to encrypt my 24 hdd´s + windows hdd/s at volume level..
 
For this reason the data is only completely safe if the OS is shut down.

This is always true, no matter what kind of kind of encryption you're using. So while true, I can't see what the downside is to this particular situation, since it applies to all situations.
 
How are you going to share out 24 separate hard drives at the same time? You'll run out of alphabet.


There is enough letters for 24 hdds.. :)

and WHS has this "Expandable Storage - Provides a unified single and easily expandable storage space, removing the need for drive letters."
 
This is always true, no matter what kind of kind of encryption you're using. So while true, I can't see what the downside is to this particular situation, since it applies to all situations.

I was just pointing out that encryption in the OPs case may not protect his data from whatever he is expecting.
 
My fileserver is entirely encrypted with TrueCrypt, although I have a slightly different configuration I may be able to offer some advice.

On boot the loader asks for the password for the encrypted OS drive (it runs Windows Server 2008 R2), you can go so far as to have it just show a blank screen with no cursor so it doesn't give you any indication that it is expecting input.

The storage array consists of 8x2TB Hitachi 7K2000s in RAID 6 on an Areca ARC-1880i. I built the array on the controller and initialized it in windows as a raw partition, then did a full format with TrueCrypt (this took ~16hrs for a single layer 256bit AES).

One of the major considerations you need to think about is performance. My fileserver has an AMD Athlon X2 6400+ and 4GB of DDR2, it benchmarks at about 255MB/s for AES in TrueCrypt. That number is the total of what it can do simultaneously, for example when I built the array I had to copy data over to it from a handful of individual 500GB-2TB drives that were temporarily attached to the server (which were also encrypted). So as you can imagine reading from several encrypted drives and writing to an encrypted array really starts to bog down the hardware, and the processor is unable to keep up with the actual potential of the drives.

A modern Xeon has been ordered to replace the AMD, as it features the AES instruction set found on modern Intel chips. I expect a significant performance gain as I read that hardware AES can give you a roughly 8x increase per clock cycle. Hopefully it can allow me to hit the full speed that the hardware is capable of (benchmarked at 940MB/s read on the top end of the array).
 
I was just pointing out that encryption in the OPs case may not protect his data from whatever he is expecting.

Oh rly? u think whole disk encryption dosnt work for covering all files from gayish organizations like mpaa? i dont see a point why it wouldnt work or i am just a noob? :p


Thnx for the nice advice.. Now i have C2D e8400 what has power but might go there that in some point there isnt enough power... so i have been thinkin about testing this how does it work.. and if dosnt.. i might get some C2Q cpu what goes to my servers older LGA775... will see.. maybe someday i will buy some new hardware what supports "hardware aes"

What method did u use to ur filesystem? all hdd´s fully encrypted or just folders or how did u do it?
 
So, you're trying to hide movies by using encryption. But you also want to share them to the local network. As long as the server is booted and you're sharing the files then whatever encryption you have on the drives won't matter. By sharing them you leave them exposed to whatever can make a connection. How you secure that connection is a different set of questions.

By encrypting the drives you're only preventing the media from being accessed when the machine is rebooted or shut down and the media accessed from a different machine. As in, the feds bust down your door and remove all your equipment. But if they access the machine while it's still booted then encryption won't save you at all.
 
So, you're trying to hide movies by using encryption. But you also want to share them to the local network. As long as the server is booted and you're sharing the files then whatever encryption you have on the drives won't matter. By sharing them you leave them exposed to whatever can make a connection. How you secure that connection is a different set of questions.

By encrypting the drives you're only preventing the media from being accessed when the machine is rebooted or shut down and the media accessed from a different machine. As in, the feds bust down your door and remove all your equipment. But if they access the machine while it's still booted then encryption won't save you at all.


I know... ^^

but tc full disk encryption should be ok anyways..
 
DECAF Tool, disabled USB ports, network policy that mandates locking terminals after 10 mins of inactivity, etc :eek:
 
Back
Top