SameTool

It's available at sourceforge.net/projects/same/

Unfortunately that version hasn't been updated in a year and a half. So I've put together an optimised version that uses a lot less memory and is much faster. It also takes directories as argument rather than just files.

The 2.0 release is now available at: www.oshineye.com/software.html It's been tested on Windows and Linux. It works.

Current performance (Athlon 1200 running Linux under Java 1.4.1) identifying duplications greater than a 100 lines in the 1,147,312 lines of code in the standard library:

 -Xmx96M? -p 500 -> 1 minute 32 seconds and -Xmx512M? -p 500 -> 40.87 seconds