The Internet Archive discovers and captures web pages through many different web
crawls. At any given time several distinct crawls are running, some for months,
and some every day or longer. View the web archive through the
Wayback Machine.
Wide17 was seeded with the "Total
Domains" list of 256,796,456 URLs provided by Domains Indexon June 26th, and crawled with max-hops
set to "3" and de-duplication set "on".