Duplicut

Nowadays, password wordlist creation usually implies concatenating multiple data sources.

Ideally, most probable passwords should stand at the start of the wordlist, so most common passwords are cracked instantly.

With existing dedupe tools, you are forced to choose whether to preserve the order OR handle massive wordlists.

Unfortunately, wordlist creation requires both.

• Features:

  • Handle massive wordlists, even those whose size exceeds available RAM

  • Filter lines by max length (-l option)

  • Can remove lines containing non-printable ASCII chars (-p option)

  • Press any key to show the program status at runtime.

• Implementation:

  • Written in pure C code, designed to be fast

  • Compressed hashmap items on 64-bit platforms

  • Multithreading support

• Limitations:

  • Any line longer than 255 chars is ignored

Source code and additional information can be found here: https://github.com/nil0x42/duplicut