Wordlist is a Ruby library and CLI for reading, combining, mutating, and building wordlists, efficiently.
Features:
Supports reading .txt wordlists, and .txt.gz, .txt.bz2, and .txt.xz compressed wordlists.
Supports building wordlists from arbitrary text. Also supports .gz, .bz2, and .xz compression.
Provides an advanced lexer for parsing text into words.
Can parse/skip digits, special characters, whole numbers, and acronyms.
Can normalize case, apostrophes, and acronyms.
Supports wordlist operations for combining multiple wordlists together.
Supports wordlist modification or mutating the words in the wordlist on the fly.
It also provides a wordlist command.
Fast-ish
Source code and additional information can be found here: https://github.com/postmodern/wordlist.rb