Duplicate file finding applications?

[blankoboy]

Hi all,

I'm looking for the most recommended software for identifying duplicate files on servers. We have a storage server (PowerVault 770N NAS running Server 2003 SP1 appliance edition) with ~600GB of space. Currently about 400GB is being used but I would like to cut this down by identifying the number of duplicate files as I am sure there are many.

ie:
xls = 50GB
exe = 30GB
pst = 25GB
doc = 21GB
tgz = 20GB
mdb = 17GB
zip = 13GB
pdf = 12.5GB.


I have tried using Treesize Pro from a remote server via a mapped drive. While it does a great job of showing the breakdown of your data it sadly cannot identify duplicate files.

Having looked around I can see a plethora of applications that perform this function but of course I would like to find the most recommended for use on servers (preferably not a homebrew app). Thanks all.

 

[defakto]

A few lines of perl should be able to do it fairly quickly. As well as save you cost as perl is free.

 

[Lazn_Work]

Upgrade to Windows Server 2003 R2, it does single instance storage on the file system.

http://blogs.technet.com/filecab/archive/2006/02/03/418730.aspx

==>Lazn