Archive for July, 2008

Some time duplicates are good things like in this image on your left. (feeling patriotic today?) But most of the time in the tech industry dupes are bad.

Today we got a question about how to kill duplicate files with different names quickly.

We immediately thought of one of our favorite old command line applications that was sitting on my shared application folder… Somewhere

We got a question from one of our readers:

Hi AtA,

Can you recommend me a program that will scan for duplicate files? I have a external HDD with multiple files with similar name, example:

filedocument.doc 2KB

filedocument-1.doc 2KB

filedocument-2.doc 2KB

Thanks,

Keep up the good work on AtA

We have been using this little application called Finddupe since Windows 98! Its free and works wonderfully! It’s chock full of command line geeky goodness. Delete duplicates, compare directories, do a test run and much more. Recover your lost space from gigz of the same porn with different names Duplicate MP3′s. Check out this info on the application and a download link below:

Finddupe is a tool for quick detecting of duplicate files on a hard drive under Windows. Duplicate files can be just detected, hardlinked, or deleted.

Deleting duplicate files
When working thru somebody else’s photo collection, or MP3 collection, this tool is useful for deleting the files that are duplicate. Depending on how the media is organized, there can be a lot of duplicate files in a collection.

Freeing hard drive space
Sometimes its intentional to have certain media in multiple places. By running finddupe, and hard linking the identical files, you can keep the files in multiple places, while only having one physical copy on the hard drive.

Detecting changed files for backup
Finddupe is useful for detecting which files have changed and need backing up. Simply back up the media, and then run finddupe to eliminate those files in the copy that are already contained in a previous backup.

Finddupe is a command line program. If you don’t know what a command prompt under Windows is, you may have to do a bit of learning before attempting to use this program. The command prompt is not DOS (before-windows), although it looks and acts a lot like that, and people unfamiliar thing that it is dos. Please don’t ask me for help if you don’t know how to use command line based programs – learn about that first.

finddupe command line options

finddupe [options] [-ref] <filepat> [filepat]…

-hardlink
Delete duplicate copies of file, and replace duplicates with hardlinks to other copy of the file. Works only on NTFS file systems, and with administrator privileges. (The C: drive under XP is almost always NTFS, and most people log in as administrator)

-del
Delete duplicate files

-sigs
Pring computed file signature of each file. The file signature is computed using a CRC of the first 32k of the file, as well as its length. The signature is used to detect files that are probably duplicates. Finddupe does a full binary file compare before taking any action.

-rdonly
Also operate on files that have the readonly bit set. I use this feature to eliminate shared files in large projects under version control at work.

-bat
Do not hardlink or delete any files. Rather, create a batch file containing the actions to be performed. This can be useful if you want to inspect what finddupe will do.

-ref <filepat>
The file or file pattern after the -ref is a reference. These files will be compared against, but not eliminated. Rather, other files on the command line will be considered duplicates of the reference files.

filepat
File pattern matching in finddupe is very powerful. It uses the same code as is used in jhead. For example, to specify c:\** would indicate every file on the entire C drive. Specifying C:\**\foo\*.jpg specifies any file that ends with .jpg that is in a subdirectory called foo anywhere on the hard drive, including such directories as c:\foo, c:\bar\foo, c:\hello\workd\foo and c:\foo\bar\foo.

Example uses

If you have a previous backup in a directory tree on c:\prev_backup, and just copied your work files to a directory tree on c:\new_backup, you can remove any files that are in the previous backup with the following incarnation:

  finddupe -del -ref c:\prev_backup c:\new_backup

If you have a large photo collection on c:\photos, and you wish to replace duplicates with hard links, you can run:

    finddupe -hardlink c:\photos

Note that this only works on NTFS file systems (such as the C drive under Windows XP). It won’t work on FAT file systems, like the ones used on most external hard disks or USB flash drives.

If you just want to know which files are common between two directory trees, you can run:

    finddupe -bat work.bat -del c:\media\** c:\media2\**

This will create the file “work bat” with file delete commands in it. The ‘-bat’ option tells finddupe to not do anything, but rather store the actions to a batch file. This allows you to review what finddupe would do before taking any action. The ‘**’ tells it to recursively do all the files.

So it does what it says and it gets rid of your dupes! What do you guys use for this? Anything or do you suffer?

_TheDuplicateAdmiN_

You need to show your buddy exactly how you do your funky effects in Photoshop? Want to record a quick tutorial on how to open ports or some other question you get hit with on the daily?

Well then check out this FREE application that TechFires tossed out at us a little whiles back. It fits perfectly with our question today! I gave it a quick whirl and besides its being as easy as shit to use it is chock full of features.

Check out this information from their homepage:

CamStudio is able to record all screen and audio activity on your computer and create industry-standard AVI video files and using its built-in SWF Producer can turn those AVIs into lean, mean, bandwidth-friendly Streaming Flash videos (SWFs)




Here are just a few ways you can use this software:

• You can use it to create demonstration videos for any software program
• Or how about creating a set of videos answering your most frequently asked questions?
• You can create video tutorials for school or college class
• You can use it to record a recurring problem with your computer so you can show technical Support people.
• You can use it to create video-based information products you can sell.
• You can even use it to record new tricks and techniques you discover on your favorite software program, before you forget them.

Don’t like the sound of your voice? No problem.

CamStudio can also add high-quality, anti-aliased (no jagged edges) screen captions to your recordings in seconds and with the unique Video Annotation feature you can even personalise your videos by including a web-cam movie of yourself “picture-in-picture” over your desktop.
And if all that wasn’t enough, CamStudio also comes with its own Lossless Codec that produces crystal clear results with a much smaller file size compared with other more popular codecs, like Microsoft Video 1.

You have total control over the output of your video: you can choose to use custom cursors, to record the whole screen or just a section of it and can reduce or increase the quality of the recording depending on if you want smaller videos (for emailing to people, for instance) or you can have “best quality” ones for burning onto CD/DVD.

But all of these features would be worthless if CamStudio wasn’t easy to use … fortunately that’s not the case. CamStudio can be learned in a matter of minutes and comes with a comprehensive built-in help file, so if you do manage to get stuck, you can simply hit “Help” and get the answers you need.

So where can I get it and how much does it cost?

You can download and use it completely free – yep – completely 100% free for your personal and commercial projects as CamStudio and the Codec are released under the GPL (for more details on this license, click here.)

There are no royalties or any monies to pay – although if you do use it for a commercial product, I wouldn’t say no to a copy of whatever you produce!

Useful Links:
CamStudio: http://www.camstudio.org/CamStudio20.exe
Lossless Codec: http://www.camstudio.org/CamStudioCodec10.zip

Thanks RenderSoftware for an awesome app!! [Via TechFires]

_TheFreeLovingAdmiN_