software that scans HDs and creates a separate directory of folders and files

[AnIgnorantPerson]

I am in the process of creating 2TB/1.xTB VC containers with 3 cascading encryptions with 0 to many key files and PIMs for my SnapRAID so I can protect my data from drive loss and corruption while having encryption levels that would require quantom computers to break. (they will eventually exist/be common place so designing my set up in mind with several decades of protection..I will obviosuly update this when 2+MB key sizes exist but if this gets stolen I have decades of piece of mind if not my life time of peace)

I am using a Norco 4224 with 20+ drives with 2:1 Data: Parity (6TB logical drives) (will upgrade to 12TB-18-24TB logical drives as prices and higher capacity becomes common place and scale Contrainers to 4-6- 8TB. I am not doing larger than 2 TB containers because at current HD speed 1 edit/resync of that container will require probably require 2-4 hour re-sync and that is the most I am willing and will also already create a large chance of data failure. 2TB is pushing it as is and I might just keep that container size on the next upgrade and just make more containers)

My data is relatizely stable minis 1-3 containers so only major resyncs would be re-organizations like moving moves/backups/pron/personal torture/rando files around

I was wondering if there was program that can scan logical drives (opened containers) and create spread sheets or GUI of drives folders/files that I can save to a master VC container (with unique and higher levels of protection obviously). That I can open and look for a folder/file with ease with out having to load 20+ complex containers hunting for what I am looking for. I have some rhyme and reason to these containers but this would simplify things greately!


Thanks for any input you can offer!

SamirD

 

[muz_j]

...
I was wondering if there was program that can scan logical drives (opened containers) and create spread sheets or GUI of drives folders/files that I can save to a master VC container (with unique and higher levels of protection obviously). That I can open and look for a folder/file with ease with out having to load 20+ complex containers hunting for what I am looking for. I have some rhyme and reason to these containers but this would simplify things greately!
Thanks for any input you can offer!
SamirD

... PowerShell sounds like the simplest tool to do what you're asking - assuming it's a standard drive / directory structure as you've stated.
The MS script repository would be easiest place to start.
If you don't know PowerShell, then your query sounds like a pretty simple task to start with - in terms of learning the basics.

Try using keyword searches, filtering by language & category and and find something (or multiple scripts to piece together) that performs one part of your task, test it and then keep going until you've got something working.
https://gallery.technet.microsoft.com/scriptcenter/

 

[AnIgnorantPerson]

... PowerShell sounds like the simplest tool to do what you're asking - assuming it's a standard drive / directory structure as you've stated.
The MS script repository would be easiest place to start.
If you don't know PowerShell, then your query sounds like a pretty simple task to start with - in terms of learning the basics.

Try using keyword searches, filtering by language & category and and find something (or multiple scripts to piece together) that performs one part of your task, test it and then keep going until you've got something working.
https://gallery.technet.microsoft.com/scriptcenter/

alright well I'll have to keep note of this. I don't know any coding or powershell but when I have time I will look into this unless someone does this before me.

did a search "scanning creating copies" and got nothing so I'll look more when I got time thanks.

These ~2TB containers are relatively static rarely opened files and I have a decent idea of what is in each so it is low priorty for me to learn how if a solution doesnt already exit.

How I use i new how to code already lol

 

[muz_j]

alright well I'll have to keep note of this. I don't know any coding or powershell but when I have time I will look into this unless someone does this before me.
did a search "scanning creating copies" and got nothing so I'll look more when I got time thanks.
These ~2TB containers are relatively static rarely opened files and I have a decent idea of what is in each so it is low priorty for me to learn how if a solution doesnt already exit.
How I use i new how to code already lol

...basically learning to script is pretty much a case of forcing yourself into it.
There are some good learning resources on the web and I personally have a pretty big collection of ebooks I've purchased over the years - powershell ones being of considerable value (to me anyway).

An example of the sort of thing you should start with trying to understand - assuming you want to try and do what you're asking with PowerShell, is this script - which is a generic script designed to export data from Powershell scripts to Excel spreadsheets. It's a generic piece of code that you could reuse and pipe the output of whatever objects you query - and it has a few simple examples of how it can be used in the headers.

https://gallery.technet.microsoft.com/scriptcenter/d41565f1-37ef-43cb-9462-a08cd5a610e2

...so that would be one part of your script - and you could obviously strip down the example code, to the bare basics that you need.

The other part of your task is creating some sort of file system report - so the URL below has examples of those - have a look through them and you might find something close to what you're wanting to do.
https://gallery.technet.microsoft.com/scriptcenter/site/search?query=report&f[0].Value=report&f[0].Type=SearchText&f[1].Value=PowerShell&f[1].Type=ProgrammingLanguage&f[1].Text=PowerShell&f[2].Value=storage&f[2].Type=RootCategory&f[2].Text=Storage&ac=4

...by breaking the task down into simple components, you can work through the whole thing piece by piece, focus on one small bit first - get that working, then work on the other, get that working, then combine the two.
PowerShell is object orientated and designed for piping data into and out of cmdlets and stringing them together - so doing a couple of small tasks is the easiest approach to learning how to get it to do what you want.

Good luck

 

[AnIgnorantPerson]

...basically learning to script is pretty much a case of forcing yourself into it.
There are some good learning resources on the web and I personally have a pretty big collection of ebooks I've purchased over the years - powershell ones being of considerable value (to me anyway).

An example of the sort of thing you should start with trying to understand - assuming you want to try and do what you're asking with PowerShell, is this script - which is a generic script designed to export data from Powershell scripts to Excel spreadsheets. It's a generic piece of code that you could reuse and pipe the output of whatever objects you query - and it has a few simple examples of how it can be used in the headers.

https://gallery.technet.microsoft.com/scriptcenter/d41565f1-37ef-43cb-9462-a08cd5a610e2

...so that would be one part of your script - and you could obviously strip down the example code, to the bare basics that you need.

The other part of your task is creating some sort of file system report - so the URL below has examples of those - have a look through them and you might find something close to what you're wanting to do.
https://gallery.technet.microsoft.com/scriptcenter/site/search?query=report&f[0].Value=report&f[0].Type=SearchText&f[1].Value=PowerShell&f[1].Type=ProgrammingLanguage&f[1].Text=PowerShell&f[2].Value=storage&f[2].Type=RootCategory&f[2].Text=Storage&ac=4

...by breaking the task down into simple components, you can work through the whole thing piece by piece, focus on one small bit first - get that working, then work on the other, get that working, then combine the two.
PowerShell is object orientated and designed for piping data into and out of cmdlets and stringing them together - so doing a couple of small tasks is the easiest approach to learning how to get it to do what you want.

Good luck

yea thats what i gathered from the wikipedia page. Still kinda spurised no one has made this already. It seems like a fairly useful and typical need in the IT world

 

[muz_j]

yea thats what i gathered from the wikipedia page. Still kinda spurised no one has made this already. It seems like a fairly useful and typical need in the IT world

...chances are likely that someone probably has created something very similar to what you're talking about, but if may or may not be shared online and depending on what the person has called it, then it might be hard to find.
On the MS script repository you'll find lots examples of file system reports - called all sorts of things.
I've written loads of ad-hoc scripts over the years at work and two scripts that do the same thing might be called two slightly different names - "Exchange Online System Report" or "Exchange Online status information" as two random examples.

If you find something close to what you want, reporting information on a given object, then it would be very easy to change it to list different properties for example. That's probably the simplest way to get something close to what you want with the least amount of work.