Have Personal Internet Archive?

[richinsc]

How many of you use your disk storage systems as personal internet archives. I'm not talking about Pr0n but I'm sure one could lump it into this category. What I am talking about is, how many of you have your own personal internet archive similar to textfiles.com archive or the real internet archive?

I bookmark stuff a lot! I often find an article, story, picture or video that I want to retain for later reading and re-reading and place it in my bookmarks. I sync my bookmarks between all my computers using xmarks. At the last count as of today my bookmarks span the range of 1968 bookmarks.

Last night however I read an article about how another person hated it when they bookmarked a site only to come back at a later time and find a dead link and unable to find the information they once bookmarked. Having been a xmarks user nigh on 4 years now I decided to see if I had some dead links. Sure enough I did. And I didn't bookmark this site of where I found the article so now of course I can't post the article.

So it begs the question for those of you who build multi-terabyte storage systems, do you download or archive what you find on the internet out of fear that it will one day disappear or that you will be unable to find the content again or that the quality of a re-post will be less if the content gets taken down. This can be anything from text, photos to video. Paid for content or unpaid for content.

If you do archive, do you catalog your archive in any special way to make it easy to find content?

 

[dustNbone]

I put the full text dump of english wikipedia on a 16gb microsd so i can read it with my phone when I'm out of cell range. I just copied the final indexed 12.9GB to the card last night but I think it will work. Text only, no images but full linked and searchable. That's alot of words.

 

[Beta4Me]

I put the full text dump of english wikipedia on a 16gb microsd so i can read it with my phone when I'm out of cell range. I just copied the final indexed 12.9GB to the card last night but I think it will work. Text only, no images but full linked and searchable. That's alot of words.

That's more than a little bit awesome.

 

[Wolfgang]

Not on my computer but I manage to keep tweaks, guides, how-to and other interesting stuff on Evernote.

Still 17XX bookmarks here.

 

[tormentum]

Interesting idea. Is there software available to do this?

I would think some kind of "proxy" with a time slider capability would make sense. If it already exists, I would probably use it as a lot of sites i've book marked say, 5 years ago, no longer exist or have been restructured and thus generate 404's now.

 

[richinsc]

Interesting idea. Is there software available to do this?

Since I use Linux as my primary os, I've just started using wget and curl for making mirrors of sites and/or pages. These two tools can be complied from source to work with windows or someone has likely already created a windows binary and posted it somewhere.

 

[Silhouette]

I did this back in the modem days, when internet usage was expensive, search engines were unreliable, and offline reading made a lot of sense.

These days I don't even use bookmarks, I count on my memory, browser autocomplete, and google.

 

[Aesma]

If there was a simple and efficient way to do it, I'd like to archive all my browsing activity.

I've got tons of bookmarks but I have stopped making new ones years ago (except for links I'll use very often), now I've got complete firefox sessions backed up (with as many as 4000 tabs) but of course that makes a limited amount of sense since the content is not there.

I just started using ScrapBook (firefox addon) to really save pages, but it isn't ideal for what I would like.

 

[cphillips]

That's more than a little bit awesome.

http://en.wikipedia.org/wiki/Wikipediaatabase_download may be useful.