gau
all
Get All URLs: fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl for any domains.
More info →Examples (7)
Fetch all URLs of a domain from AlienVault's Open Threat Exchange, the Wayback Machine, Common Crawl, and URLScan
gau example.comFetch URLs of multiple domains
gau domain1 domain2 ...Fetch all URLs of several domains from an input file, running multiple threads
gau < path/to/domains.txt --threads 4Write [o]utput results to a file
gau example.com --o path/to/found_urls.txtSearch for URLs from only one specific provider
gau --providers wayback|commoncrawl|otx|urlscan example.comSearch for URLs from multiple providers
gau --providers wayback,otx,... example.comSearch for URLs within specific date range
gau --from YYYYMM --to YYYYMM example.commade by @shridhargupta | data from tldr-pages