waymore

all

Fetch URLs of a domain from Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, and VirusTotal. Note: Unless specified, output is dumped into the `results/` directory where waymore's `config.yml` resides (by default in `~/.config/waymore/`).

More info →

Options (4)

-i, --inputboolean

Search for URLs of a domain (output will typically be in `~/.config/waymore/results/`)

Example: waymore {{[-i|--input]}} {{example.com}}

--output-urlsboolean

Limit search results to only include a list of URLs for a domain and store outputs to the specified file

Example: waymore -mode U {{[-oU|--output-urls]}} {{path/to/example.com-urls.txt}} {{[-i|--input]}} {{example.com}}

--output-responsesboolean

Only output the content bodies of URLs and store outputs to the specified directory

Example: waymore -mode R {{[-oR|--output-responses]}} {{path/to/example.com-url-responses}} {{[-i|--input]}} {{example.com}}

--to-dateboolean

Filter the results by specifying date ranges

Example: waymore -from {{YYYYMMDD|YYYYMM|YYYY}} {{[-to|--to-date]}} {{YYYYMMDD|YYYYMM|YYYY}} {{[-i|--input]}} {{example.com}}

Examples (4)

Search for URLs of a domain (output will typically be in `~/.config/waymore/results/`)

waymore [-i|--input] example.com

Limit search results to only include a list of URLs for a domain and store outputs to the specified file

waymore -mode U [-oU|--output-urls] path/to/example.com-urls.txt [-i|--input] example.com

Only output the content bodies of URLs and store outputs to the specified directory

waymore -mode R [-oR|--output-responses] path/to/example.com-url-responses [-i|--input] example.com

Filter the results by specifying date ranges

made by @shridhargupta | data from tldr-pages